Tag Archives: Google Cloud Platform

Creating a serverless ETL nirvana using Google BigQuery

Posted on March 30, 2016 by Shine Technologies

Quite a while back, Google released two new features in BigQuery. One was federated sources. A federated source allows you to query external sources, like files in Google Cloud Storage (GCS), directly using SQL. They also gave us user defined functions (UDF) in that … Continue reading →

Posted in databases, Javascript | Tagged , , , , , , , , , , , , | 4 Comments

Pablo rocking the stage at Google’s annual cloud event!

Posted on March 29, 2016 by Shine Technologies

Last week, Shine’s very own Pablo Caif gave a presentation at GCP Next 2016 in San Francisco, which is Google’s largest annual cloud platform event. Pablo delivered an outstanding talk on the work Shine have done for Telstra, which involves building solutions on the GCP … Continue reading →

Tagged , , , , , , , | Leave a comment

A week in the life of a Google Developer Expert

Posted on December 7, 2015 by Shine Technologies

A few months back, Shine’s Pablo Caif and Graham Polley were welcomed into the Google Developer Expert (GDE) program as a result of their recent work at Telstra. The projects they are working on consist of building bleeding edge big data solutions using tools like … Continue reading →

Posted in Opinion, Uncategorized | Tagged , , , , , | Leave a comment

Messages in the sky

Posted on October 19, 2015 by Shine Technologies

One of the projects that I’m currently working on is developing a solution whereby millions of rows per hour are streamed real-time into Google BigQuery. This data is then available for immediate analysis by the business. The business likes this. … Continue reading →

Tagged , , , , , , , , | Leave a comment

Shiners now officially ‘Google Developer Experts’

Posted on October 16, 2015 by Shine Technologies

You may have already read our previous post here about Shine’s Pablo Caif & Graham Polley being nominated to become ‘Google Developer Experts‘ (GDE). Well, today Shine are proud to announce that both guys have been officially awarded the braggable title of … Continue reading →

Tagged , , , , , | Leave a comment

Google Cloud Dataproc and the 17 minute train challenge

Posted on October 14, 2015 by Shine Technologies

My work commute My commute to and from work on the train is on average 17 minutes. It’s the usual uneventful affair, where the majority of people pass the time by surfing their mobile devices, catching a few Zs, or by reading a … Continue reading →

Posted in DevOps, Linux, Opinion, Tools | Tagged , , , , , , , , , , , , , , , , , , | 2 Comments

Shiners nominated for ‘Google Developer Expert’ program!

Posted on September 7, 2015 by Shine Technologies

Shine are delighted to announce that our very own Pablo Caif, and Graham Polley have both been nominated to become part of the Google Developer Expert program! Becoming an expert, means undergoing a stringent evaluation and interview process, as well as … Continue reading →

Tagged , , , , , , | Leave a comment

Test Driving Google Cloud Dataflow

Posted on February 25, 2015 by Shine Technologies

Back in June 2014, at the annual Google IO in San Francisco, Google unveiled their newest, and much hyped cloud product, Cloud Dataflow. The demo they did that day, using a live twitter feed to analyze supporter sentiment during the … Continue reading →

Posted in Testing | Tagged , , , , , , , , , , , , | Leave a comment