Time is our team’s biggest constraint but use it as an advantage— time constraints are good to force us to aggressively prioritize, keep things simpler, and cause us to think creatively. And we learn fastest getting something into user hands.
Whenever we’re evaluating the ROI of a project, we should call out the appetite we have for the project scope and then re-evaluate as needed. For reference, historically we’ve gotten many quick swings out within a calendar day and big swings out in ~3 calendar weeks.
Below is the common range for how long different swings take to start an experiment (designing → implementing → internal testing → experiment start):
Size | Scope | Risk | Examples |
---|---|---|---|
Quick swing | hours to 2 days | Low | Copy changes, redesigning a modal, etc. |
Medium swing | 1-2.5 weeks | Medium | Name an emotion, request a hug, redesigning a flow. |
Big swing | 3-5 weeks | High (ROI must be particularly high) | Redesigning home navigation, seasonal events, most new social features like gifting. |
The bigger the swing, the more time internal testing can take but 5 weeks is a less common upper bar. |
For a given project, it is often hard to know what the full scope will be until we finalize the design so we tend to scope out design and eng work separately. When designers or engineers are scoping out their own work, it tends to land in the following ballparks (caveat that a project could be a quick swing for design but medium swing for eng):
Size | Scope | Risk | Examples |
---|---|---|---|
Quick swing | 1 day or less | Low | Copy changes, redesigning a modal, etc. |
Medium swing | ≤1 week | Medium | Name an emotion, request a hug, redesigning a flow. |
Big swing | 1-2 weeks | High (ROI must be particularly high) | Redesigning home navigation, seasonal events, most new social features like gifting. |
Very few projects take 4 weeks for a designer or eng. |
It is hard to know what the full project scope is (esp for medium and big wings) until we finalize the design. But before every project starts, we do try to still have a ballpark sense of what kind of scope this likely would entail to evaluate our appetite for the project.