With this foundation, they then combined individually fine-tuned conversations that focused on emotions, conversations that employed distinct personas and conversations that were knowledge intensive using the Wizard of Wikipedia ( WoW conversation data). The strategy the researchers adopted was to first train the model on 1.5 billion publicly available Reddit conversations. Its success comes from training a model that is 3.6 times larger than the Google’s chatbot. This chatbot, from Facebook AI Research released early this spring, does better than Meena in empirical evaluation. He points out that conversation can enter into a “scary sociopath mode.” Well, I guess Google needs to fine tune this a lot more! BlenderBot As conversational chatbots go, Meena can pretty much talk about anything, one interesting tweet by a Professor Graham Neubig of CMU stands out. So, the combined metric is Sensibleness and Sensitivity Average (SSA), derived by crowdsourcing the grading of each conversation (basically, human evaluation). Is the response specific to the context of the conversation? This was dubbed “Sensitivity.”.Does the response make sense? Remarkably they named that “Sensibleness.”.So, the question is: How good is this chatbot? The authors basically boiled it down to two questions: That then feeds a complex multi-layer decoder transformer which spits out the response. The deep learning architecture used for building this chatbot utilizes a specialized transformer model, incorporating an encoder that captures the current context of the multiple turns of conversation. The data for the bot was mined from social media conversations. They must have really liked it, as it was mentioned 228 times in their paper (2). It’s a popular name in South India, where I hail from, and perhaps the Indian authors of this work came up with that name. Meena, a Google bot, released earlier this year, has a quaint name. So, here is a summary of the authors’ summary. I covered GPT-3 in an earlier blog post, but the other agents look interesting as well. Over the weekend I came across a nice summarization of recent advances in Conversational AI Agents and found these advances interesting.

Gpt 3 chatbot