Facebook releases deep learning framework PyTorch 1.1

Facebook releases deep learning framework PyTorch 1.1
Facebook releases deep learning framework PyTorch 1.1

Facebook announced the availability of PyTorch 1.1 as part of its developer conference F8. The new release of the open source deep learning library, which has been open since 2017, is expected to deliver better performance and new tools to better understand and visualize the machine learning models.

In addition, the developers have provided new APIs on Facebook. The predecessor release, PyTorch 1.0, was released in December 2018 and is now being used by companies such as Microsoft, Toyota and Airbnb, as the social network outlined in the 1.1 announcement.

Read More Stories: Cross platform with JavaScript: Electron 5.0 is ready

The highlight of the new release is probably the once again revised JIT compiler. In version 1.0, an alpha version of the compiler had landed, which probably did not work much faster than the basic mode of PyTorch. This has now been improved with the new edition of the JIT compiler, especially since it is likely that many more programming language concepts from Python to PyTorch can be implemented. The JIT compiler is able to determine at runtime how to generate the most efficient code.

PyTorch 1.1 also provides the ability to split the neural networks into GPUs. Previously, PyTorch allowed developers to split training data into processors for data-parallelism. The sharding of the models now also allows an instruction parallelism with which the networks can now also achieve “Multiple Instruction, Multiple Data” (MIMD) techniques.

Read More Stories: Social Network Analysis: In 50 years more dead than lively users on Facebook

With the command “from torch.utils.tensorboard import SummaryWriter”, the library TensorBoard now supports natively, a web application for the review and understanding of training routines and graphics. Among the new APIs are support for Boolean tensors, while those for custom recurrent neural networks have been revised.

Finally, it has worked well with the community to promote projects and tools that help ML professionals with their needs, ranging from improved model understanding to auto-tuning with AutoML methods. With the release of Ax and BoTorch Facebook has therefore opened core algorithms. BoTorch is a framework based on PyTorch to enable Bayesian optimization for the sequential optimization of black box features. In turn, Ax is a machine-learning adaptive experiment management platform that systematically explores large configuration spaces to customize models, infrastructure, and machine-learning products.

Read More Stories: OpenBSD 6.5 with new stack protector

Further information on the new PyTorch release and further developments from the PyTorch ecosystem can be found in the blog announcement. If you want to get deeper into PyTorch, you will get more detailed information on the project website.

Read More Stories: Apple At WWDC 2019 Preview: New iPads, MacBooks and iOS 13

SHARE
Previous articleNetflix: Higher bitrate and adaptive streaming for better sound
Next articlePutin signs law: Russia gets independent Internet
Aakash Molpariya
Aakash started in Nov 2018 as a writer at Revyuh.com. Since joining, as writer, he is mainly responsible for Software, Science, programming, system administration and the Technology ecosystem, but due to his versatility he is used for everything possible. He writes about topics ranging from AI to hardware to games, stands in front of and behind the camera, creates creative product images and much more. He is a trained IT systems engineer and has studied computer science. By the way, he is enthusiastic about his own small projects in game development, hardware-handicraft, digital art, gaming and music. Email: aakash (at) revyuh (dot) com

LEAVE A REPLY