Company Description
At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can’t wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make that possible. We dream big together, supporting each other to make our individual and collective dreams come true. The future is ours, and it starts with you.
With more than 7,700+ customers, we serve approximately 85% of the Fortune 500®, and we’re proud to be one of FORTUNE 100 Best Companies to Work For® and World’s Most Admired Companies™.
Learn more on Life at Now blog and hear from our employees about their experiences working at ServiceNow.
Unsure if you meet all the qualifications of a job description but are deeply excited about the role? We still encourage you to apply! At ServiceNow, we are committed to creating an inclusive environment where all voices are heard, valued, and respected. We welcome all candidates, including individuals from non-traditional, varied backgrounds, that might not come from a typical path connected to this role. We believe skills and experience are transferrable, and the desire to dream big makes for great candidates.
Job Description
Team
The Foundation Models Lab at ServiceNow Research builds the foundation for ServiceNow’s bespoke generative AI solutions, specifically tailored to meet the unique demands of our enterprise environment. Renowned for co-leading the BigCode project and releasing influential models like StarCoder and StarCoder 2, along with datasets such as the Stack and the Stack v2, our lab is now dedicated to strategic pretraining of foundation models for enterprise applications. Our mission extends beyond mere training; we aim to holistically design large language models considering their entire lifecycle. This includes curating training data to meet specific performance expectations, maximizing training efficiency, and, crucially, optimizing models for fast and cost-effective inference. By doing so, we ensure that our AI models are robust, efficient, and ready for further refinement and integration into ServiceNow’s broader AI ecosystem.
Role
We are seeking a Senior Applied Research Scientist with a passion for deep learning, GPU programming, and optimizing computational models to the maximum. In this role, you will:
- Enable large-scale model training projects that aim to significantly enhance our AI capabilities and ensure they are perfectly adapted to our platform.
- Take a lead in enhancing our 3D-parallelism training framework, aiming to make it more feature-complete and further increasing its speed and efficiency. This involves identifying compute bottlenecks and implementing critical tensor operations using OpenAI’s Triton JIT compiler to maximize GPU utilization and training throughput.
- Design, implement, and optimize novel language model architectures that prioritize inference speed and scalability, aligning with ServiceNow’s operational needs.
- Contribute to broadening our training framework’s support for a diverse range of model architectures, balancing maintainability and stability with the need for innovative features and experimentation.
- Contribute to the open-sourcing efforts of our frameworks by ensuring they are well-documented, user-friendly, and ready for external adoption.
Qualifications
To excel in this role, you should have:
- A Master’s degree with at least 2 years of relevant experience, or a Ph.D. in computer science, engineering, or a related field.
- Experience in GPU programming for deep learning, with a proven track record of optimizing large-scale systems for performance and efficiency.
- Demonstrable skills in designing and implementing innovative deep learning architectures, preferably with experience in large language models.
- Proficiency in one or more major deep learning frameworks, such as PyTorch or JAX. Familiarity with OpenAI Triton is highly desirable.
- Strong collaborative skills with the ability to work in a dynamic environment, with a track record of driving projects to completion.
- Excellent problem-solving skills and the ability to work independently on complex issues.
- Effective communication skills, capable of articulating complex technical details and collaborating across teams.
Additional Information
ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law.
At ServiceNow, we lead with flexibility and trust in our distributed world of work. Click here to learn about our work personas: flexible, remote and required-in-office.
If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at
ta****************@se********.com
for assistance.
For positions requiring access to technical data subject to export control regulations, including Export Administration Regulations (EAR), ServiceNow may have to obtain export licensing approval from the U.S. Government for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by the U.S. Government.
Please Note: Fraudulent job postings/job scams are increasingly common. Click here to learn what to watch out for and how to protect yourself. All genuine ServiceNow job postings can be found through the ServiceNow Careers site.
From Fortune. © 2022 Fortune Media IP Limited All rights reserved. Used under license.
Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, ServiceNow.