Using ADF Utilities for building ADF ARM Templates
Azure Data Factory portal is the tool for authoring and publishing ADF artifacts, that is pipelines, data sets, linked services, etc. And whilst the portal a...
Blog
2021
Using ADF Utilities Custom ARM Template Parameters Definition
In the previous post, I covered the use of ADF Utilities to validate and export ARM Templates for Azure Data Factory deployments. The process also covers the...
2020
Number Plate Recognition
Automatic Number Plate Recognition (ANPR) is used in a variety of applications, such as in parking and ticketless fee automation. In such applications, came...
Create a pandas DataFrame from a dict
It is a simple task to turn your dictionary into a pandas dataframe, however, everytime I need to do that I find my self going back to docos and stackoverflo...
2019
Visualisation Tools!
In this series, I attempted the same visualisation task in three different tools: PowerBI, Tableau, and R, to compare the methods and approach for visualisin...
first_post <- ‘Hello World!’
Shortly after Microsoft announced the availability of its Cognitive Services APIs in 2015 I started experimenting with services such as language understandin...
Green energy trends in Australia Permalink
In my previous post I looked at electricity demand and generation in Australia, and where electricity supply comes from by comparing the different energy sou...
Towards cleaner energy in Australia Permalink
Australia is a growing nation, its demand of electricity grew 10 fold in the last 60 years. Electricity demand in Australia reached 258,000 gigawatt hours (G...
Reforming NSW road fines system! Permalink
As a resident and a road user in NSW, I have a general knowledge of road rules and penalties based on my own experience! All of us are affected by government...
Using R markdown and ggplots for data visualisation
R Markdown is a file format for creating dynamic documents with R by writing in markdown language. The document contains chunks of embedded R code and conten...
Code: NSW Road Offences and Penalties Permalink
This is the code for analysing NSW Road Offences and Penalties dataset.
First Time Tableau User!
In my previous post, I looked at using Power BI desktop to build visualisations and data stories, I explored the process for importing a text/CSV data file i...
Using Power BI to explore the NSW Penalty Notices data set
In this series of blog posts I am evaluating the use of different visualisation tools for building data narratives.
Data Prep in Power BI: Load data and skip first n rows Permalink
Sometimes we need to skip a few rows when importing a data set. In R we usually use the skip parameter when using readr::read_csv() function. Here is how yo...
2018
Code: Energy Demand Short Term Load Forecast Permalink
“Some things are easier to forecast than others. The time of the sunrise tomorrow morning can be forecast precisely. On the other hand, tomorrow’s lotto n...
Code: Daily Weather Observations from Australian BOM Permalink
The Australian Bureau of Meteorology (BOM) http://www.bom.gov.au provides a number of public data services to obtain climate and past weather details, and ma...
Using Boxplots for Data Exploration Permalink
In this vignette I will explore the use of charts to display basic descriptive statistics in order understand the mean and spread of a variable in a dataset....
Stemming or Lemmatisation and tm library Permalink
Stemming is a process that removes affixes. Lemmatisation is the process of grouping inflected forms together as a single base form.