New

Data Scientist III

BMC Software, Inc
$114,525 - $190,875
United States, New York, New York
Sep 02, 2026
BMC empowers nearly 80% of the Forbes Global 100 to accelerate business value, faster than humanly possible. Our industry-leading portfolio unlocks human and machine potential to drive business growth, innovation, and sustainable success. BMC does this in a simple and optimized way by connecting people, systems, and data that power the world's largest organizations so they can seize a competitive advantage. We're looking for an experienced Data Scientist to join our Intelligent z Optimization & Transformation team (IZOT), specially for the AMI Platform team. This role will be fully remote in the US. We're unable to offer visa sponsorship at this stage. In this role, you will design and build enterprise-grade Machine Learning and Generative AI solutions that solve complex business challenges. You'll work hands-on with LLMs, RAG architecture, prompt engineering, and agentic AI frameworks, while defining how these systems are evaluated, optimized, and deployed in production environments. Key Responsibilities: Machine Learning & Generative AI Development (core focus): Design and develop Machine Learning and Generative AI solutions for complex business problems, applying statistical analysis, data mining, and machine learning techniques. Apply prompt engineering, RAG, and LLM evaluation in end-to-end AI application development. Work on complex problems where analysis of situations or data requires an in-depth evaluation of several factors. Collaborate with domain experts to understand business requirements and formulate data driven solutions. Evaluation, Governance & Enterprise Grade Quality: Deliver solutions to enterprise grade quality standards: rigorous, validated, reproducible, and ready for mission critical use. Define and implement evaluation frameworks for agent accuracy, task completion, reliability, and user satisfaction. Develop benchmarks, test datasets, and performance metrics for agentic AI systems. Contribute to AI governance, model validation, and continuous improvement initiatives. Model Optimization & Deployment: Implement strategies for model optimization, considering the constraints and requirements of mainframe environments. Support packaging and deployment of models and AI solutions into production environments. Collaboration & Communication: Explain complex technical concepts and predictive analytics clearly to both technical and non-technical audiences. Contribute to code reviews, technical documentation, and best practices. Required Experience: 6+ years of Data Science experience, with proven expertise in Machine Learning and Generative AI. B.Sc. in Computer Science, Engineering, or a related field. Experience working with Large Language Models (OpenAI, Anthropic, Gemini, Llama, or equivalent), with familiarity across different LLM architectures. Hands on experience with prompt engineering, Retrieval Augmented Generation (RAG), LLM evaluation, and AI application development. Experience designing performance metrics and evaluation frameworks for AI/ML systems. Familiarity with agentic frameworks and agent-based workflows using LangGraph, LangChain, or CrewAI. Strong proficiency in writing Python backend APIs (using FastAPI, Flask or similar) and in data science libraries such as Pandas, NumPy, scikit-learn, and PyTorch or TensorFlow. Strong knowledge of statistical analysis, hypothesis testing, data mining, and machine learning techniques. Experience querying and analyzing data using SQL and modern data platforms. Proficiency in data exploration and data visualization techniques and tools. Familiarity with cloud platforms such as OpenShift (OCP) and AWS. Self-starter with intellectual curiosity; self-learner, flexible, and able to work in a multi tasked and dynamic environment. Excellent communication skills, with demonstrated ability to explain complex technical concepts and predictive analytics to non-technical audiences. What Will Make You Stand Out: Experience with LLM evaluation and observability tooling such as Langfuse, OpenTelemetry based stacks. Experience with vector databases and embedding models for retrieval and semantic search. Experience with MLOps practices such as experiment tracking, model registries, and pipelines (MLflow or Kubeflow). Experience with fine tuning and open weight models such as Llama, Mistral, and Qwen. Experience with Agile methodology and Atlassian products (Jira, Confluence). Our commitment to you! BMC's culture is built around its people. We have 6000+ brilliant minds working together across the globe. You won't be known just by your employee number, but for your true authentic self. BMC lets you be YOU! If after reading the above, You're unsure if you meet the qualifications of this role but are deeply excited about BMC and this team, we still encourage you to apply! We want to attract talents from diverse backgrounds and experience to ensure we face the world together with the best ideas! BMC is committed to equal opportunity employment regardless of race, age, sex, creed, color, religion, citizenship status, sexual orientation, gender, gender expression, gender identity, national origin, disability, marital status, pregnancy, disabled veteran or status as a protected veteran. If you need a reasonable accommodation for any part of the application and hiring process, visit the accommodation request page. BMC Software maintains a strict policy of not requesting any form of payment in exchange for employment opportunities, upholding a fair and ethical hiring process. The annual base salary range represents the low and high end of the BMC salary range for this position. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; and other business and organizational needs. The range listed is just one component of BMC's employee compensation package. Other rewards may include a variable plan and country specific benefits. At BMC, it is not typical for an individual to be hired at /near the top of the range. A reasonable estimate of the current range is $114,525 - $190,875