In this HOWTO, we expand upon the simple Elasticsearch proxy we deployed in our first Lambda tutorial. In that tutorial, we showed you how to create a proxy in front of the AWS Elasticsearch service using a Lambda function and an API Gateway. We...
Introduction Last month, I followed the example of Full Stack Python and migrated this blog from Wordpress to Amazon Web Services (AWS) Simple Storage Service (S3). The S3 hosting approach gives me the following features: Global caching via...
From the land of Nintendo and Samurai comes Monacoin, a Japanese cryptographic currency based on Litecoin. If you look at www.coinmarketcap.com you will see that Monacoin increased about 30x in the past three months. I found it a bit challenging...
Caution! Math Ahead! For the Math-phobic, I explain how I crunch the test results in a math-free, simple and focused blog post here. I use math here, so this may be your last chance to escape! Still with me? Excellent! The bullets below outline...
Do you have big data chops? Quick, what do these three things have in common? Yankees, Giants, Rangers, Knicks What about these? Beatles, Monkees, Beach Boys Do you have an answer for each? "New York," for example, for the first list and "Rock...
All production databases require backups. The AWS Elasticsearch documentation states: Amazon Elasticsearch Service (Amazon ES) takes daily automated snapshots of the primary index shards in an Amazon ES domain... However, you must contact the AWS...
Freshlex LLC (should) architect the reliable multicast infrastructure for the putative John Carmack biopic, which will hit the Internet in December of 2018. The first blog post discusses two of the enabling technologies, FCAST and ALC. The second...
In this blog post I will revisit the first piece of code I wrote with the R Programming language, back in the early part of this decade. Coming from an Octave/MATLAB background, I really enjoyed the functional nature of R. I imagined flinging...
The RabbitMQ website provides instructions on how to install the service on CentOS and Ubuntu Elastic Compute Cloud (EC2) instances. While the Amazon Linux distro uses CentOS as a base, it is different enough to make installing RabbitMQ tricky...
The Python Elasticsearch Domain Specific Language (DSL) lets you create models via Python objects. Take a look at the model Elastic creates in their persistence example. #!/usr/bin/env python # persist.py from datetime import datetime from...
Amazon Web Services' (AWS) Lambda provides a serverless architecture framework for your web applications. You deploy your application to Lambda, attach an API Gateway and then call your new service from anywhere on the web. Amazon takes care of...
Flask-WTForms helps us create and use web forms with simple Python models. WTForms takes care of the tedious, boring and necessary security required when we want to use data submitted to our web app via a user on the Internet. WTForms makes data...
Why do we need yet another personality test? Because, without "big data" technologies online "personality tests" suffer these problems: With most tests, we quickly see a pattern to the answers, and can easily steer the test to the outcome we want...
Freshlex LLC (should) architect the reliable multicast infrastructure for the putative John Carmack biopic, which will hit the Internet in December of 2018. The first blog post discusses two of the enabling technologies, FCAST and ALC. The second...
Freshlex LLC (should) architect the reliable multicast infrastructure for the putative John Carmack biopic, which will hit the internet in December of 2018. The first blog post discusses two of the enabling technologies, FCAST and ALC. This blog...
Reliable multicast?!? How on earth can you guarantee transport using a unidirectional, asynchronous delivery method? Could you scale your solution to support ten million downstream users, each with a different capacity, varying from dial up to...
Welcome to the fifth part of this HOWTO, where we will call a remote web service to locate our test takers. Once you complete this HOWTO, you will have implemented the following architecture: To recap what we’ve done so far: Part One: Deploy an...
In HOWTO-1, we deployed an Amazon Web Service (AWS) Elasticsearch domain and connected to it via a combination of Identity and Access Management (IAM) roles, IAM profiles and the Boto library. In HOWTO-2 we deployed a Flask web server that...
In this tutorial you will: Connect a Flask server to the Bootstrap service Create a trivial Jinja2 template for a Quiz form Use Bootstrap to validate forms on the client side Use a Flask "flash" message to validate forms on the server side Let's...
In this tutorial you will learn The best* way to update an AWS provided Elasticsearch service index via an Internet facing web form *In terms of flexibility, security and ease of deployment How to deploy web forms in Flask How to get Flask to...
NOTE: Click here to find an update to this blog post which uses Boto3 and Elasticsearch 7.X Step one of our journey connects EC2 to ES using the Amazon boto Python library. I spent more than a few hours pouring through the AWS help docs and...
For my (post) masters project on machine learning and big data infrastructure I thought it would be fun to acquire my own data set. Last semester I traded available services and architected a scalable (big data) Internet facing survey...