Published inInsider EngineeringReal-Time Feature Extraction with Spark Structured StreamingImplementing Real-time Feature Extraction with Apache Spark Structured Streaming using Amazon EMR, Kinesis Data Streams and Elasticache.Oct 15Oct 15
Published inInsider EngineeringSimplifying Terraform Plan Reviews with Generative AIBoost developer productivity with AI-generated summaries of Terraform plans. Learn how to simplify infrastructure code reviews using LLMs.Jun 30Jun 30
Published inInsider EngineeringManaging AWS Resource TagsAWS resource tag use cases, strategies and tools to bulk edit tags across services easily.Mar 25Mar 25
Published inInsider EngineeringDelphi: Insider’s Machine Learning PlatformA fully automated end-to-end machine learning application lifecycle platform for multi-tenant applicationsDec 29, 2023Dec 29, 2023
Published inInsider EngineeringBuilding a Feature Store with Apache Iceberg on AWSOur journey of transitioning from individual model pipelines to a centralized feature store using Apache Iceberg on AWS.Sep 30, 2023Sep 30, 2023
Published inInsider EngineeringRealtime Alerting from Applications Logs in Amazon CloudWatchSend realtime and batch alerts over Slack for application logs in CloudWatch using SQS and Lambda services.Sep 11, 2023Sep 11, 2023
Published inInsider EngineeringDeploying AWS Lambda Functions for Machine Learning WorkloadsMachine learning workloads can be large artifacts, which must use container images to be deployed as an AWS Lambda function.Jun 21, 20231Jun 21, 20231
Published inInsider EngineeringSync Autotuner Reduced Our EMR Cost by 25%How we integrated Sync Autotuner to our Apache Spark pipelines on Amazon EMR and achieved 25% cost savings.Apr 4, 20231Apr 4, 20231
Published inInsider EngineeringHow We Migrated Our Data Lake to Apache IcebergThe architecture we built to migrate production data from Hive to Iceberg in a distributed fashion using Apache Spark on Amazon EMR.Oct 5, 20226Oct 5, 20226
Published inInsider EngineeringApache Iceberg Reduced Our Amazon S3 Cost by 90%Apache Iceberg is dramatically cost-effective compared to Apache Hive. Also enables more performant Spark jobs and cheaper Amazon EMR…Sep 28, 20229Sep 28, 20229
