Scaling experimentation program velocity from 10s to 1000s & giving thanks
TLC Connector | Teach. Learn. Converse
Hello TLC members and friends! Welcome back to the TLC Connector! Our first order of business is announcing the winner from last month’s game of Guess Who?!
Congratulations Shirley Lee of Ask Phill in Amsterdam! I will reach out for your address and ship your TLC Artic Zone cup when I get back from the 10th Anniversary celebration of the Conference formerly known as the Conversion Hotel. (If only I had brought it with me to the Netherlands…)
TLC Chatter
On this month’s episode of TLC Chatter, In honor of the U.S. Thanksgiving holiday, it’s time to give thanks to our TLC members who are always there giving back to the community.
TLCers Who Give Back
Matt Gershoff, co-founder of Conductrics, our OG sponsor, Matt is always willing to hop in and offer his thoughts, advice, and humor to any situation. Plus - he’s just a super humble guy. Have you heard? He’s “not a stats guy”, but, (like everyone else apparently), “he learned to ask the benefits and costs of the increase in Kolomogrov complexity?”
Got a technical problem? Jenn Kunz of 33 Sticks is there. She’s going to roll up her sleeves and solve it with you, screen by screen. And have fun with Legos while doing it. No question is too challenging - or too boring. I think she secretly enjoys the challenges, but she doesn’t care. There are no dumb questions - and she loves helping.
Can’t not mention Dr. Doom, himself, Cory Underwood! Like Jenn, Cory is also there for all your technical challenges - but Cory adds extra joy to all our lives by pointing out all the privacy-related doom and gloom just to cheer us all up. We wouldn’t want it any other way. Cory helps us all see what’s coming and “mind the gap”!
Lukas Vermeer, Director of Experimentation at Vista leading the DnA Hub has been giving back for most of his career and continues to do so with the TLC. His generosity is always on display as he’s answering questions about SRM errors, being willing to share (yet another) talk with us, and sharing his trademark humility which has become a hallmark trait of the TLC community.
We adore all our SMEs for their commitment to educating the industry on right practices and supporting all of us in our learning journey.
Last, but far from least, I want to thank all those who ask (and answer) great questions! You are the conversation starters! From the beginning, The Test & Learn Community has had the tagline, “Join the Conversation!” and some of you are just amazing at diving in to ask (and answer) great questions. I will name a few of you here - but there are too many of you who over the last 10+ years have made the TLC what we’ve become today for me to name. You know who you are. Thank you. So very much.
Kevin Yang, Lori Brok, Matt Policastro, Merritt Aho, Florent Buisson, Dylan Lewis, Ezequiel Boehler, Eddie Aguilar, Ronny Kohavi, Yuri S, & Bertil Hatt
How to scale your experimentation velocity: brought to you by
Velocity is critical to making experimentation impactful. Because most ideas don't prove positive impact, the best way to maximize the number of game-changing releases is to increase the number of ideas tested.
But how do you take an experimentation program from 10s of experiments to 1000s? There are a few important steps you'll need to incorporate into your experimentation process—read on to learn more.
Coming Soon: TLC Conversations & Industry Events
Dec 1 - TLC Conversation: Dale Bertrand
Dec 4-14: Accelerating Innovation with AB Testing Course w/ Ronny Kohavi (Save $500 for TLC members!)
Dec 7 - Experimentation Elite (London)
Dec 15 - TLC Conversation: Jonny Longden
Jan 12 - TLC Conversation: Craig Sullivan & Oliver Paton
Jan 26 - TLC Conversation: Erin Weigel
Jan 29-Feb 2 - Superweek
Feb 9 - TLC Conversation: Will Critchlow




