Home Blog Page 251

Visual Studio Code Now Supports SQL Server 2019 Data Clusters PySpark

Microsoft is adding support for SQL Server 2019 Big Data Clusters PySpark development and query submission in Visual Studio Code. “It provides complementary capabilities to Azure Data Studio for data engineers to author and productionize PySpark jobs after data scientist’s data explore and experimentation. The Visual Studio Code Apache Spark and Hive extension enables you to enjoy cross platform and enhanced light weight Python editing capabilities. It covers scenarios around Python authoring, debugging, Jupyter Notebook integration, and notebook like interactive query,” said Jenny Jiang, Principal Program Manager, R&D Data Analytics at Microsoft. Visual Studio Code is an open source project which is also available for Linux.

Linux Mint 19.3 Slated for Release on Christmas with HiDPI Improvements

With the Linux Mint 19.2 “Tina” operating system hitting the streets last month, the Linux Mint project has kicked off the development of the next release, Linux Mint 19.3 (codename is yet to be revealed), which is expected to arrive this Christmas with more improvements and updated components. (Softpedia)

Bringing an end to hypervisor vs bare metal debate

The debate whether hypervisors are faster than bare metal resurfaced at the vmworld 2019 conference. VMware has long maintained that hypervisors have many advantages over Bare Metal, including efficiency and cost.

“Hypervisors hosting multiple virtual machines do offer some advantages over bare metal servers. Hypervisors allow virtual machines to be created instantly, providing more resources as needed for dynamic workloads. It is much harder to provide an additional physical server when it is needed. Hypervisors also allow for more utilization of a physical server, since it is able to run several virtual machines on one physical machine’s resources. Running several virtual machines on one physical machine is more cost and energy-efficient than running multiple underutilized physical machines for the same task.” 

Are these claims true?

Rob Hirschfeld, CEO and co-founder of RackN agrees with VMware’s claims and said that the matter of the fact is that the machines people buy today to run in datacenters are hypervisor optimized. As a result, these machines are more efficient with a hypervisor than running a single operating system.

“The CPUs are designed to run multiple VMs. Taking into account the resource constraints, the operating systems are not designed to run gigantic machines,” said Hirschfeld.

The way technologies have evolved over the years stopped assuming one giant server running just one operating system. “It’s antithetical to the way we’ve bought machines for the last 10 years because of virtualization.”

However, not everyone is buying giant servers and not everyone needs virtualization. There are many use-cases where users need smaller machines with fewer processors and moderate memory. These machines are more efficient with a single operating system than a hypervisor. Edge environment is a perfect example of such cost-effective commodity servers.

From that perspective, depending on how you set-up your infrastructure, bare metal is going to be a better performer. It might also be more cost-effective and simpler to manage. “There might be many other benefits too; it’s not an A or B question,” said Hirschfeld.

That’s not going to stop people from going the hypervisor route with traditional infrastructure optimized for VMs. Hirschfeld’s advice to such users is to not buy a terabyte of RAM and as many CPUs as they can get with fiber channel SANs and stuff like that. Instead, find small cheap machines and buy a lot of them. Datacenter design is always a balancing act of how you want to manage your infrastructure and what you want that infrastructure to do.

Hirschfeld believes that we are getting out of the era of general-purpose computing:  this is the hyper-converged concept where users buy one type of machine which will solve all of their problems. “That’s an expensive way to solve the problem as it also assumes that you’re going to virtualize everything,” he said.

What’s wrong with virtualizing everything? “It’s very hard to install VMware. It takes a lot of knowledge and fiddling to get it right,” he said.

In conclusion

The world is moving towards containers. A lot of containers. Users can run Linux containers on bare metal infrastructure with great ease and efficiency. Hirschfeld clearly sees bare metal as an ideal route for edge workloads. However, he also sees the need for virtualization. It’s a balancing act. The debate between virtualization vs bare metal sounds like a religious crusade, which it’s not. It’s all about using the right tool for the right job.

“People should not think that they should not use VMs or that they should not virtualize things,” Hirschfeld said, “In our experience, there are good reasons for a lot of pieces.  Sometimes even a suboptimal solution, if it feels right to you, is a good solution.”

Kali Linux Ethical Hacking OS Switches to Linux 5.2

Offensive Security announced today the release and general availability of the Kali Linux 2019.03 operating system, a major update to the Kali Linux 2019 series that adds lots of new features, improvements, and updated hacking tools. It also brings better support for ARM architectures, a few helper scripts that makes finding information about packages more easily and automatically runs Windows binaries with Wine, or make it easier to discover what resources can be transferred over to a Windows system. (Softpedia)

Rust is the future of systems programming, C is the new Assembly (Packt)

Josh Triplett (Principal Engineer at Intel) talked with Greg Kroah-Hartman (Linux kernel maintainer for the -stable branch) about Rust. According to posts on LWN.net, they are willing to investigate a framework for the Linux kernel to load drivers that are written in Rust. For now, Rust must not be required to build Linux, but they are willing to accept a (for now) optional component to handle Rust. While this does not fundamentally change how the Linux kernel is designed, it should allow more developers to write drivers that are more stable. (LWN, PCPER)

Microsoft Releases Open Source AI Conversation Modeling Toolkit, Icecaps

Microsoft Research has unveiled Icecaps, a new open source solution for neural conversational networks. The toolkit leverages multitask learning to improve conversation AI systems, such as giving them multiple personas. “[It’s] a new open-source toolkit that not only allows researchers and developers to imbue their chatbots with different personas, but also to incorporate other natural language processing features that emphasize conversation modeling,” said a Microsoft blog. (Source: Winbuzzer, Microsoft)

Stackrox Launches Kubernetes Security Platform Version 2.5

StackRox, the security for holders and Kubernetes company, declared the general accessibility of form 2.5 of the StackRox Kubernetes Security Platform. The new form incorporates upgraded arrangement and runtime controls that empower organizations to flawlessly authorize security controls to improve use cases, including threat detection, network segmentation, configuration management, and vulnerability management. (Source: Toolbox)

Ubuntu 18.04.3 LTS Makes It Easier to Patch the Linux Kernel without Rebooting

Ubuntu 18.04.3 LTS arrived earlier this month with updated kernel and graphics stacks, as well as all the latest package updates and enhanced Livepatch integration. Powered by the Linux 5.0 kernel series from Ubuntu 19.04 (Disco Dingo), Ubuntu 18.04.3 LTS is the third maintenance updates to the long-term supported Ubuntu 18.04 LTS operating system series, which is supported by Canonical with security and software updates for at least five years, until 2023. (Source: Softpedia)

Open-source serverless framework wants to pave the way towards serverless 2.0

Lightbend has launched a new open-source serverless framework to take on the next generation of serverless. CloudState aims to go beyond the normal stateless functions most serverless initiatives take on today. According to Jonas Bonér, CTO at Lightbend, today’s current serverless movement focuses a lot on automation and infrastructure, but neglects requirements at the application layer. This is because data, streaming and event-driven stateful architectures can be challenging, he explained. (Source: SDTimes)

Ethereum Client Becomes First Public Blockchain Project on Hyperledger

Hyperledger has officially adopted its first public blockchain project in the form of ConsenSys’ Pantheon. The Hyperledger technical steering committee approved Pantheon’s addition Thursday morning, renaming the initiative to Hyperledger Besu (a Japanese term for base or foundation). Pantheon was first proposed as a potential new member of the consortium on Aug. 8, joining the likes of Hyperledger Fabric (which IBM has supported) and Hyperledger Sawtooth (backed by Intel). (Source: Yahoo!)