Big Data Engineer
Description Ascend Learning is a national leader in data driven, online educational solutions for learners, educators and employers in high-growth, licensure-driven professions spanning healthcare, fitness and wellness, skilled trades, insurance and financial services. We are passionate about accelerating learning while impacting job readiness, employment success and employee retention with the belief that our work changes lives. Our culture is intentionally results-driven and selfless with a relentless focus on our customers. We believe in trust, transparency, freedom and responsibility with a commitment to meritocracy, inclusion and diversity of thought. Continual investment in our over 1400 employees is also a core principal realized through ongoing professional development and providing opportunities to grow, develop and lead. Ascend Learning is headquartered in Burlington, MA with additional office locations and remote workers in cities across the U.S. and in the U.K. Job Overview Data Analytics is hiring a Big Data Engineer to join our team. This Engineer will be working with a team of Big Data and Java engineers besides providing hands-on guidance as we deliver actionable insights. This Engineer will work closely with agile engineering teams. Responsibilities Build and maintain data infrastructure and pipelines Gather and process raw data from disparate data sets Read, extract, transform, stage and load data on Kafka and related platforms using parallel processing programming techniques. Process unstructured data into suitable form for analysis. Support data and analytics by adhering to quality, governance, lifecycle management, and compliance. Analyze large amounts of data and help derive insights and value from them. Partner with data scientists to perform ad hoc analysis to support business decisions Maintain existing production systems Stay on top of evolving technology (streaming, etc.) to suggest, prototype and implement improvements to the data architecture. Mentor junior members of the data and analytics teams. Skills and Abilities Commitment to best software engineering practices (unit testing, TDD, code reviews etc.) and agile process. Ability to design solutions independently based on high-level architecture. Technical aptitude to partner with development teams. Ability to facilitate discussions within and outside team to derive alternatives or different approaches. Ability to own tasks outside of immediate scope of responsibility. Ability to own and complete tasks with minimum supervision. Analytical thinker and problem solver. Detail oriented with a strong focus on quality. Strong written communication skills. Requirements 3-5 years of Hands-on experience in building scalable data pipelines at multi-terabyte scale using big data technologies like Kafka, and streaming technologies like Kafka Streams is required. 3-5 years of programming language experience in JAVA is required. 5
years of experience in working with relational database systems like SQL Server, MySQL etc. is required. 5
years of strong system design/development experience in building large scale distributed systems and products. Experience writing and troubleshooting SQL queries, optimizing to improve performance, automizing using indexes, stored procedures is required. Experience with SQL SSIS skills preferred. Previous experience with designing OLAP systems in data-warehouse platforms like Snowflake, Amazon Redshift etc. is preferred. Previous experience with cloud platforms like AWS, Azure or GCP is preferred Troubleshooting:
The candidate must be able to engage in solving complex problems. Programming problems are a good example. Working knowledge of Linux or Unix is required. Understanding of shell, debugging etc. The candidate should be able to get their way around Linux and get things to work. Education and Experience Bachelor's degree in computer science or engineering is required. Knowledge of machine learning/distributed systems is preferred.
Salary Range:
$80K -- $100K
Minimum Qualification
Data Science & Machine Learning, Software DevelopmentEstimated Salary: $20 to $28 per hour based on qualifications.
years of experience in working with relational database systems like SQL Server, MySQL etc. is required. 5
years of strong system design/development experience in building large scale distributed systems and products. Experience writing and troubleshooting SQL queries, optimizing to improve performance, automizing using indexes, stored procedures is required. Experience with SQL SSIS skills preferred. Previous experience with designing OLAP systems in data-warehouse platforms like Snowflake, Amazon Redshift etc. is preferred. Previous experience with cloud platforms like AWS, Azure or GCP is preferred Troubleshooting:
The candidate must be able to engage in solving complex problems. Programming problems are a good example. Working knowledge of Linux or Unix is required. Understanding of shell, debugging etc. The candidate should be able to get their way around Linux and get things to work. Education and Experience Bachelor's degree in computer science or engineering is required. Knowledge of machine learning/distributed systems is preferred.
Salary Range:
$80K -- $100K
Minimum Qualification
Data Science & Machine Learning, Software DevelopmentEstimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
