MLOps Engineer
Location: Austin, TX
Job Type: contract
Company: IDR
Category: Development and Architecture
Job Description Apply Now
IDR is seeking an MLOps Engineer to join one of our top clients in the Healthtech-startup space (fully remote). If you are looking for an opportunity to join a large organization and work within an ever-growing team-oriented culture, please apply today!
Position Overview:
We are looking for an experienced MLOps Engineer to support the development and scaling of ML infrastructure at a cutting-edge, AI-focused startup. This role will focus on automating, monitoring, and optimizing machine learning pipelines in a cloud-native environment, primarily using GCP and Kubernetes. You’ll work closely with data scientists, ML engineers, and DevOps teams to ensure scalable and reliable deployment of machine learning models.
Required Skills:
4+ years of experience building MLOps solutions and ML infrastructure, ideally at a large-cap, AI-driven startup
Strong experience with GCP services, including Cloud Storage, Vertex AI, IAM, GKE, Compute Engine, and BigQuery
Expert-level knowledge of Kubernetes, GKE, and container orchestration for ML model deployment
Familiarity with monitoring and observability tools like Prometheus, Grafana, and OpenTelemetry
Hands-on experience automating infrastructure with Terraform
Experience implementing CI/CD pipelines for ML workflows (e.g., GitOps, Kubeflow Pipelines, MLflow)
Experience supporting multi-cloud or hybrid cloud ML deployments
Nice-to-Have Skills and Experiences:
Experience with Weights and Biases
Experience contributing to 0-1 ML infrastructure initiatives
Background in LLM fine-tuning and inference optimization (e.g., quantization, distillation)
Proficiency in LLM model serving frameworks such as TGI, VLLM, and SGLANG
What’s in it for you?
Work with cutting-edge ML infrastructure and deployment strategies
Fully remote work flexibility
Opportunity to shape infrastructure at an innovative, AI-driven startup
Collaborative and forward-thinking engineering culture
Why IDR?
Competitive compensation packages
Industry-leading benefits
Dedicated Engagement Manager who is committed to you and your success
Access to a network of top employers nationwide
Compensation Details: $60-65/hr W2
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. IDR is subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. In order to comply with these laws, we invite employees to voluntarily self-identify their race or ethnicity, gender, and veteran status (if applicable). Submission of this information is voluntary and refusal to provide it will not subject you to any adverse treatment. The information obtained will be kept confidential and may only be used in accordance with the provisions of applicable laws, executive orders, and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement. You may access this form here.