CV

General Information

Full Name Shrey Pandey
Current Role Research Fellow at Microsoft Research
Email shreypandey1509@gmail.com
Location Bangalore, India
Languages English, Hindi

Experience

  • Jan 2024 - present

    Bengaluru, India

    Research Fellow
    Microsoft Research
    Working on Conversational AI and AI Assisted Programming.
    • CoPilot Agents
      • Leading the development of LLM-powered agents aimed at eliminating technical debt in large-scale codebases by automating software development tasks.
      • Designing and implementing a dynamic AgentBuilder framework that generates agents based on customizable recipes, facilitating scalable automation of routine and complex coding operations.
    • Programming with Representation (PwR)
      • This project focuses on conversational programming, enabling developers to write software using natural language instructions, decoupling the need for extensive domain and coding expertise, making software development accessible to a broader audience, including organizations and individuals without technical backgrounds.
      • Developed a system of conversational programming where natural language conversations are translated into a custom domain-specific language with built-in guardrails using LLMs, allowing users to build software easily.
      • The DSL is then translated into Python code to run on JugalBandi-Manager, enabling seamless execution of user instructions.
      • Checkout PwR-Studio and PwR-NL2DSL.
    • JugalBandi - Manager
      • Leading the development and maintainence of the open source project - JB Manager, which aims to release and manage conversation bots built using PwR for non-profit usecases.
      • JB Manager is responsible for providing multi tenant support, language and interaction medium agnostic conversation flow chatbots using finite state machines.
      • Checkout JugalBandi - Manager here.
    • Multi-Turn Conversational Information Retrieval
      • Developed a conversational system to streamline the form-filling process using LLMs resulting in reducing inefficiency and user experience.
      • The system dynamically guides users through follow-up questions, automatically selecting and filling the correct form from a pool of 15,000 options, significantly reducing manual effort.
  • Apr 2023 - Jan 2024

    Bengaluru, India

    Senior Data Science Engineer
    Myntra
    My roles and responsibilities included, but not limited to, design and implementation of recommendation and search engines, scaling of various machine learning components and supporting product groups to enable various features across the platform.
    • NNFetch - In House Vector Database
      • Created a dynamic recommendation platform, enhancing product discovery by blending metadata filters and partitioning with HNSW and ANNOY indexing for lightning-fast nearest product retrieval.
      • Empowered multiple data science projects with a pivotal recall set generator, adapting effortlessly to evolving metadata and delivering remarkable throughput of 1M RPM at a peak P99 latency of 20ms.
      • Delivered adaptive clustering logic, optimizing recall score and latency by extending existing indexes, enabling precise adaptation to diverse business use cases with rapidly changing metadata.
  • Jun 2021 - Apr 2023

    Bengaluru, India

    Data Science Engineer
    Myntra
    • Personalised Search Ranking
      • Designed and developed a real-time, user-personalised search-ranking service, using long-term and short-term user features, query relevance, product attributes and dynamic product features in an XGBoost model optimised for CTR.
      • Engineered a high-performance solution for millions of users and products, leveraging Aerospike data store, SIMD-based cosine similarity processing, and ONNX Runtime for XGBoost model inferencing, delivering seamless operation at 500K RPM with a remarkable P99 latency of 30ms.
      • Proven positive impact on business metrics through AB tests, enhancing user experience and relevance at scale.
    • Recommendation System
      • Engineered a versatile framework for real-time product recommendations, leveraging embedding-based features and MCDA to optimize for relevance, personalization, and real-time business metrics, and using Determinantal Point Processes (DPP) to incorporate diversity in the recommendations.
      • Scaled the system to handle throughput of 5M RPM with a P99 latency of 40ms, achieving a 19x latency reduction and an 88% annual hardware cost savings compared to the previous system.
    • Machine Learning Scaling
      • Built reusable components for scaling data science models by optimizing for latency and throughput. Maintaining compatibility by python, aligning with preferences of data scientists and easy to use with minimal code changes. Proposed solutions have been adopted to improve multiple data science services at Myntra.
      • Engineered a memory-efficient solution, consolidating embedding vectors in shared memory to reduce latency by 4.5x and reduce memory footprint by 6x. Enhanced application throughput per node by enabling more worker processes per node.
      • Introduced a high-performance approach using SIMD for calculating similarity scores and re-ranking, drastically cutting computation cycles and latency. The method handles up to 15x more traffic while improving latency.
    • Image Pose Detector
      • Created an scalable online service for human pose detection from an image using a ResNet-18 model with custom layers.
      • Able to handle 27x more throughput with a 6x reduction in latency from its predecessor on a single node.
  • Apr 2020 - Jul 2021
    Software Engineering Intern
    Myntra
    Designed and implemented a two-step framework for topwear product swapping in images.
    • Developed an encoder-decoder-based generative model for preliminary image generation using Generative Adversarial Networks (GANs).
    • Developed an image refinement model for processing the generated preliminary image to incorporate garment textures, ensuring accurate top-wear product replacement while retaining pose and body shape.
    • The generated images were close to the Myntra image standards.
  • Mar 2020 - May 2021
    Software Developer
    Stealth Startup
    • Developed a music and movie recommendation system, personalised according to the preferences of multiple users in a group setting.
    • Developed the backend API server responsible for serving recommendations, user and groups management and user preferance selection.

Education

  • 2017 - 2021
    Bachelor of Technology - Computer Science and Engineering
    Motilal Nehru National Institute Of Technology, Allahabad
    • Relevant Courses
      • CS 13101 - Data Structures
      • CS 14101 - Analysis of Algorithms
      • CS 14103 - Computer Organization
      • CS 14104 - Automata Theory
      • CS 15101 - Microprocessor and its application
      • CS 15103 - Database Management System
      • CS 15106 - Computer Architecture
      • CS 16102 - Compiler Construction
      • CS 16105 - Computer Networks
      • CS 16103 - Data Mining

Projects

  • 2021
    College Bot
    An automated chat application based on deep learning to answer the day-to-day basic queries of students, such as information regarding college, etc.
  • 2020
    Cloton
    A deep learning based framework to give a virtual try room experience for the users. It is built using the principle of Generative Adversarial Networks.
  • 2019
    Distribution
    Developed a distributed file-sharing platform using TCP sockets where users can log in, create profiles, and share or download content. The platform supports a dashboard for tracking shared files and download statistics. Files are stored and retrieved across multiple nodes, ensuring redundancy and parallel downloads. Advanced features include tagging for better file search, multimedia streaming, and personalized recommendations based on user history. Efficient search and ranking mechanisms enhance file discovery, while partial file sharing supports peer-to-peer downloads.
  • 2019
    Sakshatkar
    Developed a social platform with video calls and voice calls implemented using UDP sockets, and instant messaging features. Users can log in, search and view profiles, initiate video and voice calls with chat functionality, and exchange files. Advanced features include call quality feedback, online status tracking, friend requests, notifications, offline messaging, chat history retention, and friend suggestions based on social connections.
  • 2019
    Smart Ville
    An Interactive Android App with Google Map displaying common potholes and service running in the background to detect the potholes based on readings from Accelerometer, Gyroscope, and Magnetometer.
  • 2018
    Sacred Bazaar
    An e-commerce platform built using Java for selling and buying products. Implemented features like shopping history, product search, offers, and transaction summaries. The admin functionality included customer/product management, billing, inventory control, and applying discounts. Advanced features comprised personalized discount schemes, customer segmentation, and graphical analysis of sales and customer transactions.
  • 2018
    Secure Quiz
    Designed a secure quiz platform where teachers can manage subjects, host quizzes, and add solutions. Enabled randomized question order and timed sections for multiple students simultaneously. Included automatic scoring, student-teacher queries, and encrypted data transfer for secure communication. Advanced features encompass multi-format questions, rating systems, and detailed dashboards. The platform also supports encrypted offline caching to preserve student responses during connectivity issues.

Honors and Awards

  • 2023
    Best Long Paper Award - Convergence 23
    Recieved best long paper award in Flipkart internal Data Science conference - Convergence.
  • 2023
    Annual Award 2023
    Recipient of the Annual Award for CY’22 at Myntra for contributions to scalability and cost optimizations in recommendation systems and search re-ranking. The award is given to one individual from the entire engineering department.
  • 2022
    Quarter Award JFM 2023
    It is awarded for taking ownership, doing all it takes and driving impactful results with agility.
  • 2021
    Quarter Award JAS 2023
    It is awarded for taking ownership, doing all it takes and driving impactful results with agility.
  • 2019-2020
    Won Multiple accolades in several technical competitions held at different techfests
      • Winner Of Softablitz (2019, 2020) - Softablitz is the software development event organized under the annual techno-management event Avishkar at MNNIT Allahabad
      • Winner of TuxWars (2020) - TuxWars is the Linux based event organized under the annual techno-management event Avishkar at MNNIT Allahabad
      • Winner of DevJam (2019) - DevJam is the software development contest organized under Weekend Of Code by Computer Club MNNIT Allahabad
  • 2017
    Institute Merit Scholarship
    • Provided by MNNIT Allahabad to top 10% of students in the batch for excellence in academics

Other Interests

  • Exploration: History, Geography, Arts
  • Hobbies: Culinary Arts