Lead Big Data Engineer

Date: Mar 3, 2023

Location:

Any city, TX, US, 99999

Req ID: 17100

Be part of a team that unleashes the power of leading-edge technologies to help improve the health and well-being of those most vulnerable in our country and communities. Working at Gainwell carries its rewards. You’ll have an incredible opportunity to grow your career in a company that values work flexibility, learning, and career development. You’ll add to your technical credentials and certifications while enjoying a generous, flexible vacation policy and educational assistance. We also have comprehensive leadership and technical development academies to help build your skills and capabilities.

Summary

As a Lead Big Data Engineer at Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve — a community’s most vulnerable. Connect your passion with purpose, teaming with people who thrive on finding innovative solutions to some of healthcare’s biggest challenges. Here are the details on this position.

Big Data Engineer is responsible for designing, developing, testing, tuning and building a large-scale data processing system for data products that allow Gainwell to improve quality, velocity and monetization of our data assets for both Operational Applications and Analytical needs.

Your role in our mission

Develop your career as you support Gainwell’s focus on creating innovative, purpose-built technologies and solutions to deliver better health and human services outcomes.

Responsible for leading design, development and delivery of data from operational systems and files into ODS, downstream Data Marts and files.
Works with BA’s, end users and architects to define and process requirements, build code efficiently and work in collaboration with the rest of the team for effective solutions.
Research, develop and modify ETL processes and job according to the requirements.
Develop Spark Jobs, Custom UDF using Spark RDDs, Data frames, and Spark SQL.
Strong analytical SQL experience working with dimensional modeling.
Troubleshoot and develop on Hadoop technologies including HDFS, Hive, NiFi, Hue, Pig, Flume, HBase, Spark, Kafka, Impala and Hadoop ETL development via tools such as Informatica, Talend.
Build a service structure on AZURE capable of being deployed and scaled to run a variety of platform components dynamically.
Knowledge of any Azure Data Platform components – Azure Data Lake, Data Factory, Data Management Gateway, Azure Storage Options, DocumentDB, Data Lake Analytics, Stream Analytics, EventHubs, Azure SQL.
Translate, load and present disparate data sets in multiple formats and multiple sources including JSON, Avro, text files, Kafka queues, and log data.
Implement quality logical and physical ETL designs that have been optimized to meet the operational performance requirements for our multiple solutions and products.
Experience to design the optimal performance strategy across all ETL jobs Responsible for building solutions involving large data sets using SQL methodologies, Data Integration Tools like Informatica in any database.
Experience working in Agile environment.
Deliver projects on-time and to specification with quality.

What we're looking for

10+ years of professional experience in IT.
Expert ability and hands on experience in SQL is a must.
Experience with Hadoop Eco System, Hive or related tools on Hadoop, Performance tuning, File Format, Spark, Python, Java/Scala languages (Python preferred).
Informatica/DS/SSIS, DB2, MSSQL, Teradata, Oracle 8i/9i/10g/11i, Unix/Linux and shell scripting.
Azure or AWS Cloud experience.
HealthCare Industry experience is a plus.

What you should expect in this role

Remote position
Opportunities to travel through your work (0-10%)

The pay range for this position is $86,800.00 - $124,000.00 per year, however, the base pay offered may vary depending on geographic region, internal equity, job-related knowledge, skills, and experience among other factors. Put your passion to work at Gainwell. You’ll have the opportunity to grow your career in a company that values work flexibility, learning, and career development. All salaried, full-time candidates are eligible for our generous, flexible vacation policy, a 401(k) employer match, comprehensive health benefits, and educational assistance. We also have a variety of leadership and technical development academies to help build your skills and capabilities.

We believe nothing is impossible when you bring together people who care deeply about making healthcare work better for everyone. Build your career with Gainwell, an industry leader. You’ll be joining a company where collaboration, innovation, and inclusion fuel our growth. Learn more about Gainwell at our company website and visit our Careers site for all available job role openings.

Gainwell Technologies is committed to a diverse, equitable, and inclusive workplace. We are proud to be an Equal Opportunity Employer, where all qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical condition), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We celebrate diversity and are dedicated to creating an inclusive environment for all employees.