Apply Now »

Hadoop/NiFi Administrator

Date:  Jun 19, 2024

Any city, CA, US, 99999

Req ID:  25382

Requisition ID: 25382


The Hadoop/NiFi Administrator will play a pivotal role in managing and overseeing Gainwell Technologies' Hadoop and NiFi clusters. As part of our dynamic technology team, this individual will be responsible for ensuring the robustness, scalability, and security of our data infrastructure. The role demands a deep technical expertise, a passion for problem-solving, and a commitment to continuous improvement. Working closely with various departments, the Hadoop/NiFi Administrator will contribute to strategic planning, technology evaluations, and alignment with overall business goals. This position offers an opportunity to thrive in a fast-paced environment where innovation and collaboration are highly valued. 

Your role in our mission

•    Install, configure, and maintain Hadoop and NiFi clusters, ensuring high availability and fault tolerance. 
•    Collaborate with data engineers and data scientists to optimize data pipelines, workflows, and data processing tasks. 
•    Monitor system performance and capacity, conducting proactive tuning and scaling as needed. 
•    Implement and enforce security protocols, access controls, and data governance policies in accordance with industry best practices. 
•    Conduct regular backups, disaster recovery simulations, system upgrades, and patches. 
•    Provide expert technical support, troubleshooting, and guidance to internal teams. 
•    Develop and maintain comprehensive documentation, including architecture diagrams, configuration guidelines, and operational procedures. 
•    Evaluate and recommend new technologies, tools, and best practices to enhance the existing infrastructure. 
•    Coordinate with vendors and external support teams when necessary. 
•    Assist with budgeting, planning, and reporting related to the Hadoop and NiFi environment. 

What we're looking for

•    5+ years of hands-on experience as a Hadoop/NiFi Administrator or similar role in a large-scale environment. 
•    Deep understanding of the Hadoop ecosystem components (HDFS, YARN, MapReduce, etc.) and Apache NiFi. 
•    Experience with various Hadoop distributions (e.g., Cloudera, Hortonworks) and integrating with other data platforms. 
•    Proficiency in Linux/Unix systems, shell scripting, Java, and other programming languages. 
•    Strong knowledge of networking, virtualization, cloud services (AWS, Azure, etc.), and containerization technologies (Docker, Kubernetes). 
•    Familiarity with monitoring, logging, and alerting tools such as Prometheus, Grafana, or similar. 
•    Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders. 
•    Relevant certifications in Hadoop, NiFi, or related technologies are a plus. 
•    Proven track record of successfully implementing and managing complex projects. 

What you should expect in this role

All US locations including remote are being considered. 

Video cameras must be used during all interviews, as well as during the initial week of orientation.
The deadline to submit applications for this posting is Friday July 5, 2024.



•    Master's degree in Computer Science, Engineering, or a related field preferred. 
•    Certifications in Hadoop, NiFi, or other related big data technologies. 
•    Extensive experience in managing multi-cluster environments and cross-platform integrations. 
•    Familiarity with data warehousing, ETL processes, and real-time data processing. 
•    Knowledge of data privacy regulations and compliance requirements such as GDPR, HIPAA, etc. 
•    Proven ability to mentor and lead technical teams, fostering a culture of collaboration and continuous learning. 
•    Experience in project management methodologies (e.g., Agile, Scrum) and utilizing project management tools. 
•    Exposure to Artificial Intelligence (AI) and Machine Learning (ML) technologies is a plus. 
•    Strong interpersonal skills, with a proven ability to build relationships and effectively communicate with stakeholders at all levels. 
•    Demonstrated commitment to staying up to date with emerging technologies and industry trends.


To harness the power of innovation, we invest in the development of diverse employees. We aspire to leverage the qualities and appreciate the unique competencies that each person brings to our company.

Our company is committed to the principles of Equal Employment Opportunity and to providing reasonable accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with us and are in need of accommodation or special assistance to navigate our website or to complete your application, please contact us.  Requests for reasonable accommodation will be considered on a case-by-case basis.

EOE AA M/F/Vet/Disability:

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, gender, sexual orientation, gender identity, protected veteran status or disability.

Apply Now »