Senior GPU Optimization Engineer

Adobe Inc.
United States, California, San Jose
345 Park Avenue (Show on map)
Nov 12, 2024
Our Company Changing the world through digital experiences is what Adobe's all about. We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital experiences! We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We're on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! The Opportunity Firefly is the new family of creative generative AI models coming to Adobe products that offers a new way to conceptualize, build, and scale content. It's a natural extension of the technology Adobe has produced over the past 40 years. At the core of Firefly are our commercially safe AI models trained on hundreds of millions of images owned or licensed by Adobe. We are hiring for a highly strategic and visible role to apply GPU optimization skills towards improving the training efficiency and performance of these models. This is an opportunity to reach millions of creatives, helping them reinvent the way they work. What you will be working on: Interfacing with model architecture teams to co-design with hardware in mind Write efficient kernels for forward and backward passes in CUDA, Cutlass / CuTe, Triton Write optimized custom layers using PyTorch Leverage FP8 to accelerate training and inference Optimize model efficiency for Hopper/Blackwell GPU architectures Write high quality, product level code that is easy to maintain and test while following standard development methodologies What you will need to succeed: B.S., M.S, or Ph.D. in Computer Science, Computer Engineering or a related areaand 5+ years related experience Proficiency in Linux, Docker Understanding of modern transformer-based model architectures Expert in Python and PyTorch Understanding of distributed training fundamentals Experience in C++ with an emphasis on Python integration Expert in CUDA, Triton Experience with Cutlass / CuTe Expert in profiling - Nsight, Kineto, etc. #FireflyGenAI Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this positionis $170,900 -- $325,200 annually. Paywithin this range varies by work locationand may also depend on job-related knowledge, skills,and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP). In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award. Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and "fair chance" ordinances. Adobe is proud to be anEqual Employment Opportunityand affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law.Learn more. Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, emailaccommodations@adobe.comor call (408) 536-3015. Adobe values a free and open marketplace for all employees and has policies in place to ensure that we do not enter into illegal agreements with other companies to not recruit or hire each other's employees.