Clik here to view.
Building a file explorer on top of Amazon S3
Amazon S3 is a simple file storage solution that is great for storing content, but how well does it stack up when used as the storage mechanism for a web-based file explorer? Recently I was tasked with...
View ArticleClik here to view.
NoSQL in the cloud: A scalable alternative to Relational Databases
With the current move to cloud computing, the need to scale applications presents itself as a challenge for storing data. If you are using a traditional relational database you may find yourself...
View ArticleClik here to view.
High availability, low latency streaming to BigQuery using an SQS Queue.
When you have a Big Data solution that relies upon a high quality, uninterrupted stream of data for it to meet the client’s expectation you need a solution in place that is extremely reliable and has...
View ArticleClik here to view.
Will Athena slay BigQuery?
With the announcement of Amazon Athena at this year’s AWS re-invent conference, I couldn’t help but notice its striking similarity with another rival cloud offering. I’m talking about Google’s...
View ArticleClik here to view.
Cloud Next 2017 – Shifting to the Cloud
Last week I had the privilege of attending Google Cloud Next in San Francisco. With Google finally due to open a datacenter in Australia this year, it was certain to be a great opportunity to learn...
View ArticleClik here to view.
To Partition or not to Partition
I have been using BigQuery for over 2 years now at Shine. I’ve found it to be a great tool that is both incredibly fast and able to handle some of our largest workloads. We are processing terabytes of...
View Article