: Expert Talks Pune: Microservices War Reports: Two Tales from real-life Microservices projects
Two tales from a real-life microservices experience tell war stories about big data, cloud, and stuff. This is how projects are. Everything matters. Here are some of the stations: AWS, ELB, HTTP, Java, Linux, lsof, netstat, POSIX, S3, TCP/IP, ulimit.
Speakers
This talk will be given by Christian Hujer and Rajan Patil who worked together for 18 months on the same big data microservices project.
Tale 1: Analyzing and Solving a 504 Gateway Timeout Problem on AWS
A change in the way users used the system resulted in downtime of services caused by 504 Gateway Timeout on the ELBs.
- What does that mean?
- What is causing it?
- And how to fix it?
This touches all layers of a project from DevOps and infrastructure via understanding HTTP and TCP/IP networking and POSIX operating systems to proper resource handling in source code (in this case, Java).
- The problem: 504 Gateway Timeouts
- The analysis: From structure to tools how we found the culprit with system knowledge and systematic search
- The solution — once more: Clean Code!
Tale 2: Migrating 190M records from DynamoDB and S3 to MongoDB
In one of our projects, we had to migrate 190M records from DynamoDB and S3 to MongoDB. In a live system.
This is the story of how we achieved that: how we did that, what went wrong along the way, and what we did about those things. This is about both, the migration script as well as the service reprogramming.
- Planning
- Testing
- Pitfalls
- Firefighting