Data Engineer, Network Capacity ServicesDESCRIPTION
AWS is one of the world's largest and most highly-available networks, that continuously grows year over year, increasing in complexity and criticality. Scaling the network to meet user's demand is a unique challenge: Network Capacity Services (NCS) builds the infrastructure to manage the demand forecast and the planning of the future state of the network. We own the software system that predicts future needs, elaborates where new network infrastructure has to be deployed, and builds the plan according to physical constraints. The complexity, size, and speed of growth reflect on the software we develop and operate, which must fit the need of a mission critical function for AWS.
We are looking for a Data Engineer to build the data pipelines and centralised data store for applications within the NCS organisation which supports the scaling of one of the world's largest and most complex networks. Our customers rely on Amazon's network for their success and our data engineers supports building a cost-effective and unconstrained network by transforming and ingesting data into the datastore and producing metrics and insights for data-driven network planning. Within the NCS team, you will champion frameworks that empower our internal customers to seamlessly consume network planning data. The ideal candidate possesses a robust understanding of data modelling concepts. Continual acquisition of expertise, iterative approaches, and adaptability are key facets of this role. We seek individuals deeply committed to pragmatic problem-solving and unafraid to pioneer new territories. Your ability to craft extendable designs and maintainable technical solutions while keeping long-term visions in focus will be paramount.
You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.
Key job responsibilities
- Be part of a high-bar, agile team with global responsibility and build infrastructure to enable data-driven network planning.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using AWS big data technologies.
- Explore and learn the latest technologies to provide new capabilities and increased efficiency.
- Collaborate with Data Scientists and Business Intelligence Engineers (BIEs) to recognise and help adopt best practices in reporting and analysis and help users make the most out of the data for their decision making.
BASIC QUALIFICATIONS
- Experience in data engineering
- Experience with data modeling, warehousing and building ETL pipelines
- Knowledge of distributed systems as it pertains to data storage and computing
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
#J-18808-Ljbffr