Data Engineer

Who we are: BAL is a team of brilliant people who change lives through elite immigration work and collaborative innovation. We pursue the exceptional in all that we do, but never at the expense of our values. There’s no denying our work is demanding, both in volume and pace, but we’re up for the challenge. We love the balance of hard work and fun – so, you’ll see us in jeans as we shatter glass ceilings and conventional stereotypes. BAL employees feel valued, rewarded, and respected. We seek opportunities to be of service to others and our communities. We are committed to your growth and development, and want to set you up for success here at BAL and beyond.

Who you are: You are looking for work that has a purpose. You aren’t afraid to roll up your sleeves and get stuff done. You learn quickly. You move fast. You embrace challenge and detail as well as creative thinking. You believe you have something unique to contribute and you aren’t afraid to raise your hand. You understand that powering human achievement is ultimately about impacting a real person. You are looking for a place to grow and an environment where everyone has a spot and is genuinely welcome.

We’re better together: A bright, driven person like you and an industry-leading powerhouse like BAL? It’s a perfect combination! We truly want to see you succeed here and become an integral part of our mission to provide an experience that makes a positive difference in people’s lives. Come be a part of something special, where you can have an impact and be valued just for being you!

In addition to competitive pay, a discretionary annual bonus, and a supportive, team oriented culture, we offer an outstanding benefits package that includes medical, dental, vision, disability, and life insurance, sick time, unlimited vacation, and 401(k) with company match.

OVERVIEW:

We are looking for an experienced Data Engineer to join our Data Products team, working primarily on data pipelines and related automation. The ideal candidate will have experience in a variety of data engineering technologies and a keen attention to detail.  In this role, you will focus on designing, building, and managing resilient and scalable data pipelines, implementing production automations and integrations, and optimizing performance and quality across our portfolio.

PRIMARY RESPONSIBILITIES:

• Design, develop, and maintain scalable, high-performance data pipelines and ETL processes that clean, transform, and integrate data from various sources, ensuring data is prepared and accessible for downstream consumers.
• Manage and enhance production data workflows and automations for external and internal integrations, implementing continuous improvement initiatives to standardize technologies, improve monitoring and alerting systems, and optimize our production automation infrastructure.
• Optimize database performance, implement schema changes, and maintain data governance standards to enhance reporting capabilities, analytics, and data integration processes.
• Collaborate with the Data Engineering Manager and cross-functional teams to understand business requirements and develop optimal data solutions that meet organizational needs.
• Apply strong analytical and problem-solving skills to translate complex business requirements into efficient, scalable, and maintainable solutions.
• Establish, implement and maintain testing and monitoring processes to ensure production data is always accurate, consistent, and readily available.

QUALIFICATIONS:

• Minimum of 5 years of experience in data engineering or associated software development.
• Bachelor's degree in a related area or a combination of relevant certifications and job experience.
• Experience designing, building, and operationalizing large-scale enterprise data solutions and applications, including ETL/ELT data flows, using technologies such as Spark, EMR, Databricks, Glue, Kinesis, Redshift, Snowflake, etc.
• Proficiency in Python/PySpark, various dialects of SQL, and batch scripting (Shell, Bash, PowerShell); experience with C# a plus.
• Experience developing and optimizing complex SQL and Python for high-volume, high-efficiency data extraction and transformation.
• Familiarity with cloud services and tools (AWS preferred) including storage, serverless functions, and data engineering tools.
• Experience testing, monitoring, and rectifying data anomalies to ensure data integrity.
• Building and maintaining batch scripts, cron jobs, and similar forms of automation in production environments.

ADDTIONAL EXPERIENCE A PLUS:

• Data platforms like Databricks or similar technologies.
• REST API development and/or integration using OpenAPI/Swagger and languages like Python or C#.
• Experience with machine learning and AI pipelines and MLOps.
• Experience with containerization (Docker/Kubernetes) and related tools and patterns.
• Experience with CI/CD and DevOps tools and processes (e.g. Azure DevOps, Terraform).
• Experience with user-facing report and dashboard development.

The ideal candidate likes to work both independently and collaboratively in a small, convivial team.

Note: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed are representative of the knowledge, skill, and/or ability required and are not intended to be an exhaustive list of all duties, responsibilities or qualifications associated with this job.

Berry Appleman & Leiden is an Equal Opportunity Employer. It is the policy of BAL to ensure an equal employment opportunity without discrimination or harassment on the basis of race, color, national origin, religion, gender, gender identity or expression, age, disability, alienage or citizenship status, marital status, creed, genetic predisposition or carrier status, sexual orientation or any other characteristic protected by law. BAL prohibits and will not tolerate any such discrimination or harassment.

BAL does not accept unsolicited resumes from recruiters or employment agencies. BAL is under no obligation to pay any referral compensation or recruiter fee in the absence of a current executed Recruitment Services Agreement. In the event a recruiter or agency submits an unsolicited resume or candidate without an agreement, BAL reserves the right to pursue and hire said candidate(s) without any financial obligation to the recruiter or agency. Any unsolicited resumes, including those submitted to hiring managers, shall be deemed the property of BAL. If your agency would like to be considered as a potential recruiting partner, please forward your contact information to Recruitment@BAL.com.