Scenarios

Reference scenarios for the workshop. We'll work through these together.

0. Introduce Yourselves!

We'll be using group discussions as a way to solidify our thinking about Ralph and get new ideas from each other.

Go round and introduce yourselves with these three questions:

• What's your name?
• What's your development background? (new/long-time dev?)
• What are you looking to get out of the workshop?

1. What Did You Notice?

Now that you've had a go with Ralph doing human-in-the-loop, what did you notice?

• Did it pick sensible tasks? (i.e. not too big, not too small?)
• Did it go completely off the rails?
• Did it produce high-enough quality code?
• Would you trust it to run AFK?

2. What Are The Risks Of AFK Ralph?

• What are the risks of running AFK Ralph?
• How many commits would you trust it to make in a row?
• What else freaks you out about AFK Ralph? (or are you chill about it)

3. When Picking A Task Goes Wrong

Handing over the job of picking a task to the agent is quite dangerous. What can go wrong?

Here are some of my examples - can you think of any others?

• Ralph chooses too large a task?
• Ralph builds only the feature, with no tests?
• Ralph builds a feature before fixing a critical bug?

4. Skills vs AGENTS.md vs Prompt

Which of the below should you put into skills, AGENTS.md, or prompts?

• Package installation instructions
• Task Prioritization Instructions
• TypeScript Best Practices
• Commit Message Best Practices
• Library-Specific Docs

5. Reviewing Ralph's Code

How often should you review Ralph's code?

• Every Commit
• Every Sprint, Before Merging
• Review Only Some Commits
• No Review
• ...?

6. Ralph And Git

How would you integrate Ralph into your team's git workflow?

• Ralph commits to main (with feature flags)
• Ralph PRs to main
• ...?

7. Triage Ralph

How could a Ralph loop help handle a GitHub issue backlog?

Design a Ralph Loop That:

• Takes a list of public GitHub issues
• Triages them and creates reproductions of the bugs
• (optional) Passes off to another Ralph loop to PR a fix

8. Ralph & Code Quality

Compared with working with human devs, does code quality matter more, the same, or less?

• Code quality matters MORE
• Code quality matters the SAME
• Code quality matters LESS

9. How Ambitious Can We Be?

How big a task can you hand Ralph in a single Sprint?

• Build an entire app from scratch
• Add 10 features to an existing app
• Refactor an entire app to a new frontend framework
• Migrate an app from JavaScript to TypeScript
• Migrate an app from TypeScript to Rust