Sr. Data Engineer; IT eCommerce

Multiple Locations
Required Experience: 0 year(s)
Employment Type: Full-Time
Salary Range: Not available
Posted 2 days ago
Job Description
JOB DESCRIPTION Our customers are requesting a wide variety of revenue generating and platform enabling requirements from real-time and long-term analytics to data compliance with HIPAA and GDPR in EU regulations to AI and Machine Learning applications. It enables Digital advertising, Personalized experience on consumer facing applications, Business Intelligence, Machine Learning, Analytics plus more. You will work with engineers, product managers, data science team, digital marketing team and others to launch new products and support existing ones. Successful candidates will have shown the ability to ship quality product in a fast-paced environment. We expect you to understand requirements and be able to work and communicate with other Engineering teams across the organization. • Minimum 4 years hands-on experience developing complex systems . You must have experience with SOA designs, Middleware solutions, Hadoop ecosystem and distributed systems. • Understanding of real-time and batch data processing systems. • Understanding of AWS Redshift solution implementation using Apache Avro, AWS Glue or data pipeline based data load process. • Experience building and configuring an EMR instance and using hive for data access. • Experience building architecture to support realtime use cases using Lambda functions and API gateway to expose these functions as service. • Experience working with no sql databases and best practices around setting up DynamoDB and elastic search service • Experience working with and building Kinesis data streams for realtime data stream analysis. • Ideally, you have experience in a production Cloud / DevOps environment. LOCATION1155 Battery St. San Francisco, CA, 94111FULL TIME/PART TIMEFull time