Cade Metz, Genius Makers: The Mavericks Who Brought AI to Google, Facebook, and the World, Dutton, 2021.
王曉伯譯,AI製造商沒說的祕密: 企業巨頭的搶才大戰如何改寫我們的世界?,時報文化,2022
Cade Metz, Genius Makers: The Mavericks Who Brought AI to Google, Facebook, and the World, Dutton, 2021.
王曉伯譯,AI製造商沒說的祕密: 企業巨頭的搶才大戰如何改寫我們的世界?,時報文化,2022
Kenji Hiranabe, Graphic notes on Gilbert Strang's "Linear Algebra for Everyone"
I tried intuitive visualizations of important concepts introduced in "Linear Algebra for Everyone".
Kaufmann, E., Bauersfeld, L., Loquercio, A. et al. Champion-level drone racing using deep reinforcement learning. Nature 620, 982–987 (2023). https://doi.org/10.1038/s41586-023-06419-4
First-person view (FPV) drone racing is a televised sport in which professional competitors pilot high-speed aircraft through a 3D circuit. Each pilot sees the environment from the perspective of their drone by means of video streamed from an onboard camera. Reaching the level of professional pilots with an autonomous drone is challenging because the robot needs to fly at its physical limits while estimating its speed and location in the circuit exclusively from onboard sensors. Here we introduce Swift, an autonomous system that can race physical vehicles at the level of the human world champions. The system combines deep reinforcement learning (RL) in simulation with data collected in the physical world. Swift competed against three human champions, including the world champions of two international leagues, in real-world head-to-head races. Swift won several races against each of the human champions and demonstrated the fastest recorded race time. This work represents a milestone for mobile robotics and machine intelligence, which may inspire the deployment of hybrid learning-based solutions in other physical systems.
Yaodong Yu, Sai Praneeth Karimireddy, Yi Ma, and Michael I. Jordan, Scaff-PD: Communication Efficient Fair and Robust Federated Learning, arXiv:2307.13381.
We present Scaff-PD, a fast and communication-efficient algorithm for distributionally robust federated learning. Our approach improves fairness by optimizing a family of distributionally robust objectives tailored to heterogeneous clients. We leverage the special structure of these objectives, and design an accelerated primal dual (APD) algorithm which uses bias corrected local steps (as in Scaffold) to achieve significant gains in communication efficiency and convergence speed. We evaluate Scaff-PD on several benchmark datasets and demonstrate its effectiveness in improving fairness and robustness while maintaining competitive accuracy. Our results suggest that Scaff-PD is a promising approach for federated learning in resource-constrained and heterogeneous settings.