hero

Come work with us.

We’re looking for great people, who love their work, solving problems, and having fun.

Senior Data Engineer

Steady

Steady

Data Science
United States · United States · Remote
Posted on Sep 18, 2024

SteadyIQ seeks a sharp, highly motivated data engineer who is excited to play a significant role in our product and engineering evolution. We seek product-focused, results-oriented engineers who thrive in a collaborative, team-focused culture. You will work closely with data scientists, backend engineers, DevOps, QA engineers, analysts, product managers, business stakeholders, and your team to help define, implement, and ship significant increments to the data infrastructure that powers SteadyIQ’s mission-driven products.

As a Senior Data Engineer, you will:

  • Design, develop, and deliver high-quality, performant, scalable, well-tested, documented, and sensible solutions suitable to high-impact technical challenges.
  • Administer, maintain, and improve SteadyIQ’s data infrastructure and data processing pipelines, including ETL jobs, events processing, and job monitoring and alerting.
  • Engage in all agile software development lifecycle phases in a cross-functional team setting.
  • Partner with Product, Engineering, DevOps, Data Science, and senior leadership to define and refine our data architecture and technology choices.
  • Fearlessly work across components, services, and concerns to deliver business value.
  • Collaborate with data scientists and analysts to prepare complex data sets that can be used to solve difficult problems.
  • Help define, implement, and reinforce data engineering best practices and processes.
  • Contribute to SteadyIQ’s technical vision.
  • Safeguard SteadyIQ’s data by implementing/maintaining masking, access control, and protection policies

Skills & Requirements

  • Significant data engineering and software development experience (5+ years)
  • Experience developing scalable production software in Python
  • Experience with the AWS data ecosystem, e.g., Step Functions, Lambda, CloudWatch, SQS, EventBridge, API Gateway, and SAM
  • Experience with partitioning strategies, indexing, and caching techniques for performance tuning.
  • Experience ingesting, processing, and transforming a variety of data at a scale and in the cloud. Ideally, with spark-hosted databricks—preferred experience with DLT pipelines.
  • Expertise in optimizing queries and ETL processes for large-scale, complex datasets.
  • Experience automating ETL pipelines using DAGs to control flow and orchestrate dependency-heavy workflows. Examples of tools are Airflow, Prefect, and Databricks Jobs.
  • Demonstrated proficiency with SQL and NoSQL databases, plus data warehousing concepts
  • Proficiency in setting up robust monitoring and alerting for data pipelines
  • Experience implementing and maintaining data security frameworks such as HIPAA or GDPR.
  • Proficiency with encryption, data masking, and role-based access control (RBAC).
  • Experience with developing CI/CD processes using Jenkins and GitHub actions
  • Ability to thrive in a fast-paced and dynamic environment
  • Ability to work well in teams of all sizes with representatives from a diverse set of technical backgrounds
  • Preferred: Experience with cost optimization in cloud environments, particularly around storage and compute efficiency (e.g., leveraging AWS Glue, S3 storage classes, or Lambda for serverless functions).
  • Preferred: Experience building or maintaining a data science development environment such as Databricks, including deployment and monitoring using tools like MLflow
  • Preferred: Experience with infrastructure tools like Terraform, CloudFormation, OpenTofu, etc.
  • Bachelor’s or Master’s degree in Computer Science or equivalent experience

Total Compensation Package

  • The base salary range for this position is $145,000 - $175,000.
  • This position is eligible for equity.
  • We offer a 100% company-paid benefits package for employees and their families, including medical, dental, and vision. We also offer unlimited time off and future growth opportunities within the company. We strive to maintain a positive and fun environment for our employees where people can learn and grow with the company.
  • This compensation and benefits information is based on the employer’s good faith estimate as of the publication date and may be modified at the company's discretion. The pay level within the range will depend on various job-related factors, including relevant prior experience and/or education or particular skills and experience.

About SteadyIQ

SteadyIQ is at the forefront of a technology revolution in public benefits delivery. Our proprietary platform, Income Passport, is a consent-based income verification solution that makes submitting proof of earnings more accessible, efficient, and effortless. Leveraging the power of user-permissions data, SteadyIQ works with government agencies nationwide to streamline benefit applications, reduce administrative burdens, and prevent fraud.

For more information, visit us at www.steadyiq.com

Steady Platform Inc. (SteadyIQ) is an Equal Employment Opportunity employer – All qualified applicants/employees will receive consideration for employment without regard to that individual’s age, race, color, religion or creed, national origin or ancestry, sex (including pregnancy), sexual orientation, gender, gender identity, physical or mental disability, veteran status, genetic information, ethnicity, citizenship, or any other characteristic protected by law. Statement to ALL Third-Party Agencies and Similar Organizations: SteadyIQ accepts resumes only from agencies where we formally engage their services. Please do not forward resumes to our applicant tracking system, SteadyIQ employees, or SteadyIQ hiring manager or send to any SteadyIQ facility. Steady is not responsible for any fees or charges associated with unsolicited resumes.