{"id":"2037031496","title":"Software Co-Design AI HPC Systems","posted_at":"2026-02-12T21:49:36.000Z","apply_url":"https://apply.careers.microsoft.com/careers/job/1970393556752258","locations":["Mountain View, CA"],"employment_type":null,"workplace_type":"on_site","seniority_level":"senior","description_language":"en","source_name":"eightfold","source_url":"https://apply.careers.microsoft.com/careers/job/1970393556752258","salary":{"min":142800,"max":274800,"currency":"USD","period":"year","display":"$142,800–$274,800"},"job_summary":null,"job_description":null,"description_text":"Overview\n\nOur team’s mission is to architect, co-design, and productionize next-generation AI systems at datacenter scale. We operate at the intersection of models, systems software, networking, storage, and AI hardware, optimizing end-to-end performance, efficiency, reliability, and cost. Our work spans today’s frontier AI workloads and directly shapes the next generation of accelerators, system architectures, and large-scale AI platforms. We pursue this mission through deep hardware–software co-design, combining rigorous systems thinking with hands-on engineering. The team invests heavily in understanding real production workloads large-scale training, inference, and emerging multimodal models and translating those insights into concrete improvements across the stack: from kernels, runtimes, and distributed systems, all the way down to silicon-level trade-offs and datacenter-scale architectures. \n\nThis role sits at the boundary between exploration and production. You will work closely with internal infrastructure, hardware, compiler, and product teams, as well as external partners across the hardware and systems ecosystem. Our operating model emphasizes rapid ideation and prototyping, followed by disciplined execution to drive high-leverage ideas into production systems that operate at massive scale. \n\nIn addition to delivering real-world impact on large-scale AI platforms, the team actively contributes to the broader research and engineering community. Our work aligns closely with leading communities in ML systems, distributed systems, computer architecture, and high-performance computing, and we regularly publish, prototype, and open-source impactful technologies where appropriate. \n\nStarting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location. This expectation is subject to local law and may vary by jurisdiction.\n\nResponsibilities\n\n- Lead the co-design of AI systems across hardware and software boundaries, spanning accelerators, interconnects, memory systems, storage, runtimes, and distributed training/inference frameworks.\n\n- Drive architectural decisions by analyzing real workloads, identifying bottlenecks across compute, communication, and data movement, and translating findings into actionable system and hardware requirements.\n\n- Co-design and optimize parallelism strategies, execution models, and distributed algorithms to improve scalability, utilization, reliability, and cost efficiency of large-scale AI systems.\n\n- Develop and evaluate what-if performance models to project system behavior under future workloads, model architectures, and hardware generations, providing early guidance to hardware and platform roadmaps.\n\n- Partner with compiler, kernel, and runtime teams to unlock the full performance of current and next-generation accelerators, including custom kernels, scheduling strategies, and memory optimizations.\n\n- Influence and guide AI hardware design at system and silicon levels, including accelerator microarchitecture, interconnect topology, memory hierarchy, and system integration trade-offs.\n\n- Lead cross-functional efforts to prototype, validate, and productionize high-impact co-design ideas, working across infrastructure, hardware, and product teams.\n\n- Mentor senior engineers and researchers, set technical direction, and raise the overall bar for systems rigor, performance engineering, and co-design thinking across the organization.\n\nQualifications\n\nRequired/Minimum Qualifications\n\n- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.\n\nAdditional or Preferred Qualifications\n\n- Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or PythonOR equivalent experience.\n\n- Strong background in one or more of the following areas:AI accelerator or GPU architectures\n- Distributed systems and large-scale AI training/inference\n- High-performance computing (HPC) and collective communications\n- ML systems, runtimes, or compilers\n- Performance modeling, benchmarking, and systems analysis\n- Hardware–software co-design for AI workloads\n\n- Proficiency in systems-level programming (e.g., C/C++, CUDA, Python) and performance-critical software development.\n- Proven ability to work across organizational boundaries and influence technical decisions involving multiple stakeholders.\n- Experience designing or operating large-scale AI clusters for training or inference.\n- Deep familiarity with LLMs, multimodal models, or recommendation systems, and their systems-level implications.\n- Experience with accelerator interconnects and communication stacks (e.g., NCCL, MPI, RDMA, high-speed Ethernet or InfiniBand).\n- Background in performance modeling and capacity planning for future hardware generations.\n- Prior experience contributing to or leading hardware roadmaps, silicon bring-up, or platform architecture reviews.\n- Publications, patents, or open-source contributions in systems, architecture, or ML systems are a plus.\n\nSoftware Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.\n\nCertain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:\nhttps://careers.microsoft.com/us/en/us-corporate-pay\n\nThis position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.\n\nMicrosoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.","visa_sponsorship":null,"experience_years_min":null,"job_address":null,"job_city":null,"job_state":null,"job_country":null,"location_lat":37.3893889,"location_lng":-122.0832101,"closed_at":null,"apply_with_ai_eligible":false,"keywords":["distributed training","cross-functional","infrastructure","architectures","communication","stakeholders","architecture","prototyping","scalability","large-scale","distributed","performance","engineering","end-to-end","production","algorithms","multimodal","JavaScript","trade-offs","Microsoft","ecosystem","hardware","Platform","modeling","Ethernet","roadmaps","internal","external","evaluate","research","leading","develop","design","Mentor","global","Python","teams","local","speed","data","LLMs","CUDA","HTML","Java","GPU","C++","ML","AI","C+"],"company":{"name":"Microsoft","slug":"microsoft","logo_url":"https://img.logo.dev/microsoft.com?token=pk_fWx5G5QrQMm-0Ud8BW3mBg&size=64&format=png","description":"Microsoft is a technology company that develops software, services, and AI-native business solutions, including the Dynamics 365 platform, to empower individuals and organizations globally.","website_url":"https://microsoft.com","linkedin_url":"https://www.linkedin.com/company/microsoft","glassdoor_url":"https://www.glassdoor.com/Overview/Working-at-Microsoft-EI_IE1651.11,20.htm","x_url":"https://x.com/Microsoft","instagram_url":"https://www.instagram.com/microsoft/","youtube_url":"https://www.youtube.com/microsoft","github_url":"https://github.com/microsoft","huggingface_url":"https://huggingface.co/microsoft","tiktok_url":"https://www.tiktok.com/@microsoft","crunchbase_url":"https://www.crunchbase.com/organization/microsoft","facebook_url":"https://www.facebook.com/Microsoft/","employee_count_range":"10000+","employee_count":228000,"founded_year":1975,"headquarters":{"address":"One Microsoft Way, Redmond, WA 98052, United States","city":"Redmond, WA","country":"US","lat":47.6694141,"lng":-122.1238767},"industry":"software","company_type":"other","total_funding_usd":null,"locations":["Abilene, TX","Abu Dhabi, UAE","Ajman","Al Khobar, Eastern Province","Albany, NY","Amsterdam, NH","Arlington, VA","Ashburn, VA","Athens, Greece","Atlanta, GA","Atlanta, GA, US","Auckland, New Zealand","Austin, TX","BG, Serbia","Barcelona, CT","Beijing, China","Bellevue, WA","Bengaluru, India","Bengaluru, KA, IN","Bentonville, AR","Berkeley, CA","Berlin, Germany","Bogotá, Bogota","Boston, MA","Bothell, WA","Boydton, VA","Brasília, DF","Brisbane, Australia","Brussels","Bucharest, Romania","Busan","CA","CABA, Buenos Aires","CR","Cairo, Cairo Governorate","Calgary, Canada","Cambridge, MA","Cambridge, United Kingdom","Canberra, Australia","Cape Town, South Africa","Cardiff, United Kingdom","Chandler, AZ","Charlotte, NC","Charlotte, NC, US","Cheltenham, United Kingdom","Chennai, TN","Cherry Hill, NJ","Cheyenne, WY","Chicago, IL","Cologne, Germany","Columbus, OH","Copenhagen, Denmark","Cyberjaya, Malaysia","Dallas, TX","Dammam, Eastern Province","Delft, Netherlands","Des Moines, IA","Detroit, MI","Doha, Qatar","Dubai","Dublin, D, IE","Dublin, Ireland","Dulles, VA","EE","EG","Eemshaven, Netherlands","El Mirage, AZ","El Paso, TX","Elkridge, MD","Enfield, United Kingdom","Espoo, Finland","Fargo, ND","Fayetteville, GA","Frankfurt, Germany","Garden City, NY","Gelugor, Malaysia","Geneva, GE","Goodyear, AZ","Guangzhou, Guangdong Province","Guaynabo","Gävle, Sweden","HK","HKI, Uusimaa","Haifa, Haifa District","Haiphong, Hai Phong","Hanoi, Vietnam","Hebei, China","Herzliya, Tel Aviv District","Hillsboro, OR","Ho Chi Minh City, Vietnam","Hong Kong Island, HK","Honolulu, HI","Houston, TX","Hyderabad, India","Hyderabad, TS, IN","ID","Indianapolis, IN","Ireland, Multiple Locations","Irving, TX","Issy-les-Moulineaux, IDF","JO","Jakarta","Jamnagar, GJ","Jeddah, Makkah Province","Johannesburg, GP","Johor Bahru, Malaysia","Kuala Lumpur, Malaysia","LU","Lima, Callao Region","Lisbon","Lithia Springs, GA","London, United Kingdom","Los Angeles, CA","Louisville, KY","Lund, Skåne County","Luxembourg City, Luxembourg District","Lyngby, Denmark","MY","Madrid, MD","Makati City, Philippines","Malaga, Australia","Manassas, VA","Marseille, France","Medellín, Antioquia","Miami, FL","Middenmeer, Netherlands","Milan, Italy","Milwaukee, WI","Modi'in-Maccabim-Re'ut, Israel","Montreal, Canada","Mountain View, CA","Mt Pleasant, WI","Mumbai, India","Munich, Germany","México D.F., CDMX","México D.F., CDMX, MX","NZ","Nairobi, Nairobi County","Nantong, China","New Delhi, India","New York City, NY","New York, NY","Newport, United Kingdom","Noida, India","OM","ON, CA","Osaka","Oslo, Norway","Ottawa, Canada","PH","PR","Palmetto, GA","Paris, France","Perth, WA","Phoenix, AZ","Prague","Pune, India","Quincy, WA","Québec City, Canada","RS","Raleigh, NC","Reading, United Kingdom","Red Oak, TX","Redmond, WA","Redmond, WA, US","Reno, NV","Reston, VA","Reston, VA, US","Richmond, VA","Riyadh, Saudi Arabia","Rome, Lazio","SA","SP, Brazil","San Antonio, TX","San Diego, CA","San Francisco, CA","San Jose, CA","San José, San José Province","Sandviken, Gavleborg County","Santa Barbara, CA","Santa Clara, CA","Santiago de Querétaro, Qro.","Santiago, Chile","Schiphol, NH, NL","Schiphol, Netherlands","Seattle, WA","Seoul","Sepang, Malaysia","Shanghai, China","Shenzhen, Guangdong Province","Slough, United Kingdom","Springfield, VA","St. Louis, MO","Stavanger, Norway","Sterling, VA","Stockholm, Sweden","Suzhou, China","Sydney, Australia","São Paulo, Brazil","TH","TR","Taipei, Taiwan","Tallinn, Harju County","Tampa, FL","Taoyuan City, TW","Tel Aviv, Israel","Tokyo, Japan","Toronto, Canada","Tulsa, OK","US","VIC, Australia","Vancouver, Canada","Vienna","Vélizy-Villacoublay, IDF","Warsaw, Masovian Voivodeship","Washington, DC","Wellington, New Zealand","Wenatchee, WA","West Des Moines, IA","West Lafayette, India","Zaragoza, AR","Zurich, ZH","İstanbul","กทม, Bangkok"]},"structured_data":{"@context":"https://schema.org","@type":"JobPosting","@id":"https://worklittle.com/jobs/2037031496#job","title":"Software Co-Design AI HPC Systems","description":"Software Co-Design AI HPC Systems at Microsoft. View role details and apply on Worklittle.","datePosted":"2026-02-12T21:49:36.000Z","validThrough":"2026-03-14T21:49:36.000Z","url":"https://worklittle.com/jobs/2037031496","directApply":true,"hiringOrganization":{"@type":"Organization","name":"Microsoft","sameAs":"https://microsoft.com","logo":"https://img.logo.dev/microsoft.com?token=pk_fWx5G5QrQMm-0Ud8BW3mBg&size=64&format=png"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","streetAddress":"One Microsoft Way","addressLocality":"Mountain View","addressRegion":"CA","postalCode":"98052","addressCountry":"US"}},"employmentType":"FULL_TIME","identifier":{"@type":"PropertyValue","name":"Microsoft","value":"2037031496"},"baseSalary":{"@type":"MonetaryAmount","currency":"USD","value":{"@type":"QuantitativeValue","minValue":142800,"maxValue":274800,"unitText":"YEAR"}}}}