The Bing platform team works on the Bing web search backend system, provides search platform for Microsoft internal partners. We are managing one of the world’s largest distribute systems, and have been very successful in building efficient large scale distributed system for search. With the advancing in hardware, machines are becoming more and more powerful, how to fully utilize machine resources is becoming a bigger challenge. The agility of engineering and deployment is also a big challenge when handling such a big complex system. With Bing becomes more and more intelligent, the need for platform to build up AI intelligence is becoming bigger and bigger.
The MagneTar team is a new team in platform team, trying to tackle these challenges. We are trying to fully utilize our backend system’s resources by harvesting the spare resource in our backend system, and build an OSS big data processing layer to fulfill Bing’s offline compute requirements. Our team operates a Hadoop cluster with tens of thousands of Windows nodes, on top of which we run a full-spectrum Hadoop open-source software stack, including HDFS, Yarn, Spark, Flink, ZooKeeper, Kafka, and TensorFlow, etc. Our Hadoop cluster hosts a full suite of critical large-scale machine-learning/deep-learning computational tasks across Bing, from DL model training/serving, ANN building/serving and offline big data processing by DL models, to support fusing of AI into our search and other areas.
The team culture values engineering quality, technical excellence, and grass roots innovation. We foster a supportive and productive work environment to provide growth avenues for each team member.
As a software engineer in the MT team, you will work with engineers to enrich and improve the multitenant platform for more capability, stability and convenience for OSS big data processing. You will also need to work closely with relevance team to build a streamline and integrated E2E DL experience. We have opportunities to build domain expertise across the broad distributed systems and open source projects in areas such as cluster management and resource scheduling, performance isolation, container, Hadoop/HDFS/Spark/Kafka, etc. You also work closely with OSS community to contribute back our work.
- A good foundation in computer science
- Strong skills in software design, problem solving and communication
- BS in computer science or related field
- 4+ years of software development experience with high quality coding and debugging ability in any of the following languages: C, C++, C#, Java, Python
- Systems development experience is a plus, as is experience in one or more of Distributed Systems, open source Hadoop, Spark, Docker etc.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
To apply for this job please visit careers.microsoft.com.