Job Descritpion of AWS Glue & Amazon Security Lake Specialist
4 to 6 Years Relevant Experience
Key Responsibilities
- Design and develop robust ETL/ELT pipelines using AWS Glue, Glue Studio, and Glue DataBrew.
- Ingest, catalog, and process large volumes of structured and unstructured data.
- Set up and maintain Amazon Security Lake to centralize multi-source security logs.
- Optimize data lakes for cost, performance, and scalability using partitioning and data lifecycle strategies.
- Collaborate with Security and DevOps teams to integrate logs with tools like Athena, OpenSearch, and SIEM platforms.
- Build and maintain Glue Jobs and Crawlers for automated data processing and metadata cataloging.
- Monitor and troubleshoot pipeline performance and cost efficiency.
- Implement IAM roles, policies, and encryption mechanisms for secure access control.
- Derive actionable insights from security data using Amazon Athena, QuickSight, or other BI tools.
- Contribute to solution architecture and define best practices for cloud-native data processing and security.
Must-Have Skills
- Hands-on experience with AWS Glue, including Glue Studio and DataBrew.
- Proficiency in Amazon Security Lake for managing centralized security log data.
- Strong development skills in Python, PySpark, or Scala for building scalable ETL/ELT pipelines.
- Understanding of cloud data governance, compliance, and security best practices.
- Experience in data partitioning, lifecycle policies, and performance tuning of AWS-based data lakes.
Good-to-Have Skills
- AWS Certification (Developer, Data Analytics, or Security).
- Background in security operations, incident response, or SIEM integrations.
Required Skills for AWS Glue & Amazon Security Lake Specialist Job
- Amazon Security Lake
- AWS Glue development
- Python
- PySpark
- Scala
Our Hiring Process
- Screening (HR Round)
- Technical Round 1
- Technical Round 2
- Final HR Round