One of the big themes I had in the hallway track of MicroConf a couple of weeks ago surrounded A/B testing, which I guess I’m a little known for here. It looks like everyone is running A/B tests now. They’re building their own frameworks with LLMs, feature-flagging new ideas, and going off the results.

I actually love this. One of my favorite clients home-rolled their framework. Another one of my old clients built a whole Rails gem for experimentation back in the day. Most contemporary frameworks are too heavy-handed and too expensive to justify for the price.

But this also creates a lot of methodological questions.