ZF
@zffc
Reviewer #3 would say: This paper simply combines rope jumping and soccer ball juggling, neither of which is considered new.
Skipping rope and juggling ball at the same time? This boy is a master at multitasking! 👍
Great work by @GoogleAI researchers @lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen. 13.5 BLEU point gain is really significant!
arxiv.org/abs/2006.16668 We scaled the Transformer model with Sparsely-Gated Mixture-of-Experts using GShard, and trained a 600B multilingual translation model in about 4 days (for 100 languages) achieving 13.5 BLEU gain compared to the baseline.
Not that many systems handle 6B QPS. 😀 "Bigtable has been in continuous production use at Google for more than 15 years now, processing over 6 billion requests per second at peak and with over 10 exabytes of data under management. " cloud.google.com/blog/products/…
I view my talk as a chance to exchange ideas w/ students. Some points I raised: - Be interdisciplinary, à la A. van Leeuwenhoek - Read papers older than you - On fast-evolving topics, my students outpace my knowledge - My last serious coding session? During Obama's 1st term 😑
I'm sharing my @UCLA_CGSI talk slides last week surveying recent #LLM methods in genomics (DNA, scRNA). As exciting as LLM's potential in genomics is, a note of skepticism remains. Hope we maintain vigilance in what we publish. Feedback on slides welcome. cs.cmu.edu/~jianma/talks/…
arxiv.org/abs/2105.04663 GSPMD aka "Sharding is all you need". Foundational work for Giant Models by Yuanzhong Xu et al! *generalized from GShard backend system
This week we will be presenting three papers at #ICLR2021 each exploring a different aspect of multi-task/multilingual models at scale: (1) modeling (2) optimization and (3) large scale systems.
Tragic...
Tragic—a mother lost **both** her sister and her 13 year old son Peyton to #COVID19. The bereaved mom took the bold step to publicly share the chilling images of her son’s blood-spattered hospital room in a bid to urge Americans to take COVID seriously. the-sun.com/news/1995186/s…
Surround yourself with people who care about and encourage you to reach higher.
A statement signed by 150 people incl. Bill T. Jones, Wynton Marsalis, Jennifer Finney Boylan, Noam Chomsky, J.K. Rowling, Margaret Atwood, and Salman Rushdie expresses concern over the illiberal trend intensified by our national reckoning. harpers.org/a-letter-on-ju…
An Economist Looks at 90: Tom Sowell on Charter Schools and Their Enemies youtu.be/9boQrCPwMws via @YouTube
I absolutely don't condone anyone being personally attacked on social media. I just haven't seen this in my feed here. If anyone reading this is part of attacking you or anyone else, I say this to you: Please stop. Personal attacks have no place in scientific discourse.
unbelievable.
More than 100 people showed up to this Orange County Board of Supervisors meeting to speak out against face mask regulations