Microsoft is adding support for SQL Server 2019 Big Data Clusters PySpark development and query submission in Visual Studio Code. “It provides complementary capabilities to Azure Data Studio for data engineers to author and productionize PySpark jobs after data scientist’s data explore and experimentation. The Visual Studio Code Apache Spark and Hive extension enables you to enjoy cross platform and enhanced light weight Python editing capabilities. It covers scenarios around Python authoring, debugging, Jupyter Notebook integration, and notebook like interactive query,” said Jenny Jiang, Principal Program Manager, R&D Data Analytics at Microsoft. Visual Studio Code is an open source project which is also available for Linux.
