Backend System Design Time Allocation

Search for a command to run...

Cohere is one of the leading enterprise AI companies, building large language models purpose-built for business use cases. While most people in AI circles know them for their models and APIs, fewer know about one of their most interesting roles: Forward Deployed Engineer.

OpenAI needs no introduction. They're the company behind ChatGPT, GPT-4, and DALL-E. But most people don't know about one of their most interesting roles: Forward Deployed Engineer. An FDE at OpenAI i

xAI has been impossible to ignore. Elon Musk's AI company is building Grok (the AI powering X), running massive GPU clusters, and now expanding into X Money payments. When I got the chance to intervie

Sakana AI's interview process is refreshingly different. The month-long take-home project rewards depth over speed. The technical interview is a conversation about real experience, not a coding exam. And the culture fit round tests whether you can operate in a fast-moving research startup.

Sierra has been one of the most interesting AI startups to watch. Founded by Bret Taylor (former Salesforce co-CEO) and Clay Bavor (former Google VP), they're building AI agents for customer service, and they're hiring in Japan and Singapore etc.

A good enough framework for 60 minutes allocation looks like this:
Different companies want a different thing. So you have to clarify unless they give you very detailed instructions. Some popular questions/assumptions look like
For estimation, confirm with your interviewers because not every company wants a number. Unless you are asked for, skip the estimation step to save time for other steps.
The goal of this step is to provide a big picture to show that we fulfil the functional requirements. At the end of this step, both you and your interviewer should have a general idea of how the data flow from request to response. Some common things you could talk about are:
To save time, skip talking about optimization, scaling etc. So no load balancers, no replicas at this point.
This is where you want to spend most of your time because
Always confirm with your interviewers which components are they more interested in. This is the step you want to mention:
If you have more questions than time allowed, it's ok to ask your interviewers to stay more for a few minutes. I did and so far no interviewer rejected.