摘要: The journey of data analytics began with simple descriptive (review of past events) and diagnostic (analysis of past events) exercises and moved to the more sophisticated predictive and prescriptive genres,where advanced data models have enabled accurate future forecasts and actionable intelligence. And now cognitive computing has further strengthened the actionable predictive power of the machines by making the machine act like the human brain. For example, in addition to deciphering “words” in a piece of text, a cognitive analytics system can also interpret the context of the written material.

摘要: 去年NLP領域最火的莫過於BERT了,得益於數據規模和計算力的提升,BERT在大規模語料上預訓練(Masked Language Model + Next Sentence Prediction)之後可以很好地從訓練語料中捕獲豐富的語義信息,對各項任務瘋狂屠榜。我們在對BERT進行微調之後可以很好地適用到自己的任務上。如果想深入了解BERT的運行機制,就需要去仔細地研讀一下BERT的源碼。今天這篇文章我們來看看在BERT提出大半年之後,又有哪些基於BERT的有趣的研究。

Popular Tags