Data Science Virtual Machine (DSVM) announcement
-
Link
We’ve listened to your feedback on how we can enhance the forum experience. Microsoft Q&A allows us to add new functionality and enables easier access to all the technical resources most useful to you, like Microsoft Docs and Microsoft Learn.
Now until November 9, 2020
- You can post any new questions on Microsoft Q&A or here.
From November 9, 2020 until November 23, 2020
- New posts – Post any new questions in the DSVM forum’s new home on Microsoft Q&A. The current forum will not allow any new questions.
- Existing posts – Interact here with existing content, answer questions, provide comments, etc.
November 23, 2020 onwards:
- This forum will be closed to all new and existing posts and all interactions will be in Microsoft Q&A
We are excited about moving to Microsoft Q&A and seeing you there.
-
Link
A new refresh of the Windows Data Science Virtual Machine Image has been released to the Azure marketplace. You will see the version as 1.6.1 on the marketplace listing page of the VM on Azure.
The following are the highlights in this release:
1. [BREAKING CHANGE] Jupyter Notebook Server is disabled by default. A new script (c:\dsvm\tools\setup\JupyterSetPasswordAndStart.cmd) has been created to help you set the Jupyter password and start the Jupyter server. This is a one time process. There is a convenient shortcut on the desktop that you can double click to do this operation. You may have to wait a few seconds after setting the password before accessing Jupyter from your browser.
2. The following are the major new software on the VM:
- Microsoft Cognitive Toolkit 2.0 (also known as CNTK). Now a Python interface (Python 3.4) is available to build your deep neural networks. Comes with lots of samples, notebooks and hands-on labs.
- Weka 3 - An open source Visual Data Mining Software in Java.
- Apache Drill - An open source schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage. Supports ODBC and JDBC interfaces to enable querying NoSQL and files from standard BI tools like PowerBI, Excel, Tableau.
- eVince PDF reader
- Side-by-side install of Microsoft R Open 3.3.1 (Enhanced Open source R distribution based on and 100% compatible with R-3.3.1). This is in addition to the default R instance which is Microsoft R Server developer edition (which in turn is based on R-3.2.2). You can switch to Microsoft R Open 3.3.1 if you need to run R programs that depend on the latest R version.
- OpenJDK 1.8.0_102 : An open source implementation of Java Standard edition platform.
- A new conda environment for Python 3.4 in addition to the existing Python 2.7, Python 3.5.
- R libraries: RSQLServer library to access SQL Server databases through the dplyr interface; dplyrXdf library to work with Microsoft R Xdf files using the dplyr paradigm.
- Mozilla Firefox browser. Jupyter notebook software is better tested and supported on Firefox. If you are see issues with running notebooks on default IE browser, please retry with Firefox.
- Visual Studio Code - An open source code editor supporting several popular programming languages and extensions. Particularly useful for editing / previewing markdown and a lightweight client to work with Git repositories.
- Libraries to access objects stored in Azure Data Lake Store (WebHdfs) from Microsoft R Server using the R functions RxHdfsFileSystem, RxTextData.
We have a few more new samples. They are can be found on the Jupyter notebooks home (c:\dsvm\notebooks on the VM instance) when you login to the Jupyter server on the new data science VM. Non-notebook samples are found in c:\dsvm\samples. You can also download detailed labs for Cortana Intelligence Advanced Analytics labs and Microsoft R Server from shortcuts found on desktop or from c:\dsvm\samples\Labs.
-
Link
If you are already using or are planning to use the Data Science Virtual Machine (DSVM), you are definitely not alone.
A rapidly growing number of people and organizations globally from across different industries with diverse skills and requirements have started to use the DSVM. This is quickly expanding the number and types of problems that people are trying to solve using the DSVM. It is our intention to build and grow this community and promote the healthy sustainable conversations, community based problem solving and knowledge sharing that Microsoft forums have always been known for. The DSVM team is committed to being actively engaged in the conversations and responding whenever possible and required.
The forum is intended to be the central location for our customers to interact with their peers and the DSVM team. This dialogue greatly helps not only the community and new users but also the DSVM team to make the right decisions about what direction to take the product, in future releases.
We encourage you to ask a question today.
Click to Download the 2-page DSVM Handout as PDF.
-
0 Votes
Data transfer
I m shifting my office to a new location, and I am purchasng new computers. I want to transfer all my data from new old computers to new ones. Please help me with this. I cant loose my data. Since i ...Unanswered | 0 Replies | 50 Views | Created by Inox steel india - Tuesday, November 3, 2020 11:31 AM -
0 Votes
Installing the LAD extension doesn't work on Data Science Ubuntu 18.04 image
I've noticed the LAD extension (https://docs.microsoft.com/en-us/azure/virtual-machines/extensions/diagnostics-linux) doesn't install on the Data Science Ubuntu 18.04 image, and after asking several ... -
0 Votes
Reno App - An Yield Management Platform for Restaurants (www.renoapp.in)
Reno App uses data science to gather data points on getting its restaurants best quality traffic during peak and off - peak hours. Manipulating consumer behaviour is not a one night job. It takes ... -
0 Votes
Unable to proceed with Cumulative Update SQL Server 2017 Standard Edition
I was in the of process of updating company SQL Server 2017 but was unable to proceed. The check box for SQL Server Instance was unchecked and version report shows that Integration Services and SQL ... -
0 Votes
Importing data from google ads using ADF v2 is filtering results
My intention is similiar to the web post subject(Importing data from google ads using ADF v2) . Except that when I submit query like below using ADF through a google adwords connector and dataset the ... -
0 Votes
Microsoft Azure Blockchain Workbench Deployment Error
I have tried deploying Azure Blockchain Workbench several times using different regions but it still gives the following ... -
0 Votes
URGENT HELP WORD
Hi, Please can someone give me any advice. I completed my assignment and accidentally deleted it and saved a new version which is just the ... -
0 Votes
Downgrade CUDA in DSVM Ubuntu
device: XLA_CPU device 2020-06-23 22:34:54.618237: I tensorflow/core/common_runtime/direct_session.cc:359] Device mapping: /job:localhost/replica:0/task:0/device:XLA_CPU:0 -> ... -
0 Votes
Getting Current / Active session in Azure virtual machine using powershell(Runbook)
I'm trying to get the current active session in Azure VM through the Runbook PowerShell. If there is no any active session / usage then planning to stop the ... -
0 Votes
opencv and cnn creation of new image on the basis of old
I am looking for how to create new images on the basis of old these images are in geometric form I finish the cnn soon the rnn I would like to have advice on the library to use and documentation links -
0 Votes
Azure DPS and IoT Hub : IotHubUnauthorizedAccess;Unauthorized
How to solve this "Message":"ErrorCode:IotHubUnauthorizedAccess;Unauthorized" Can you share a working node.js code for provisioning a single device using DPS and ... -
0 Votes
Microsoft Data base for Appsheet
<p>Hopefully this is the right spot.</p><p>I work for a substance abuse treatment facility, and we have begun to migrate into appsheet, for various daily functions. We have the ... -
0 Votes
My Mouse is Not Working Properly And Have Various Issues
Hello, I am currently working on various projects via my Pc in which I installed Windows 8. I ... -
0 Votes
Linux docker container msbuild 2015
Hi I am looking for a docker image to set up the automatic build process on linux machine (gitlab) for my sql server database project. Can you please help me to find out from ...Unanswered | 3 Replies | 344 Views | Created by mukejee - Monday, March 30, 2020 2:11 PM | Last reply by shivani_sambare - Wednesday, April 1, 2020 9:25 PM -
0 Votes
dsvm windows 10 image or dsvm detailed installation
Hi all We are facing at a huge customer in France a big security problem on DSVM when connecting to it with citrix. In fact we have only ...Unanswered | 1 Replies | 312 Views | Created by HODA EL HADDAD - Wednesday, February 5, 2020 2:04 PM | Last reply by Paul Shealy [MSFT] - Tuesday, February 11, 2020 10:37 PM -
0 Votes
Spark kernel not working with Jupyter and Fresh Install of newer Ubuntu 18.04 (preview) DSVM
> ~hadoop/.ssh/authorized_keys chmod 0600 ~hadoop/.ssh/authorized_keys chown hadoop:hadoop ~hadoop/.ssh/id_rsa chown hadoop:hadoop ...Answered | 2 Replies | 356 Views | Created by richds - Saturday, January 25, 2020 7:58 PM | Last reply by richds - Friday, January 31, 2020 2:01 PM -
0 Votes
Not able to do pip install on DSVM
pip install recordlinkage Collecting recordlinkage Using cached ...Unanswered | 1 Replies | 537 Views | Created by tiwari.yogi - Tuesday, November 19, 2019 1:36 PM | Last reply by banibrata_de - Wednesday, November 20, 2019 9:27 PM -
0 Votes
DSVM R package update
Hi there, There is version difference in R package in our on prem linux machine and azure DSVM R package. How to rectify the situation.Answered | 3 Replies | 421 Views | Created by Anshik - Monday, October 21, 2019 7:10 AM | Last reply by Paul Shealy [MSFT] - Thursday, October 24, 2019 9:19 PM -
2 Votes
Updated images?
Hi, Our datascience team recently reviewed the current W2016 DSVM Marketplace offering. Their conclusion was that almost all installed software is seriously ...Unanswered | 1 Replies | 392 Views | Created by smerkx - Monday, September 9, 2019 9:20 AM | Last reply by gopalv-MSFT - Wednesday, October 2, 2019 12:04 AM - Items 1 to 20 of 141 Next ›
Data Science Virtual Machine (DSVM) announcement
-
Link
We’ve listened to your feedback on how we can enhance the forum experience. Microsoft Q&A allows us to add new functionality and enables easier access to all the technical resources most useful to you, like Microsoft Docs and Microsoft Learn.
Now until November 9, 2020
- You can post any new questions on Microsoft Q&A or here.
From November 9, 2020 until November 23, 2020
- New posts – Post any new questions in the DSVM forum’s new home on Microsoft Q&A. The current forum will not allow any new questions.
- Existing posts – Interact here with existing content, answer questions, provide comments, etc.
November 23, 2020 onwards:
- This forum will be closed to all new and existing posts and all interactions will be in Microsoft Q&A
We are excited about moving to Microsoft Q&A and seeing you there.
-
Link
A new refresh of the Windows Data Science Virtual Machine Image has been released to the Azure marketplace. You will see the version as 1.6.1 on the marketplace listing page of the VM on Azure.
The following are the highlights in this release:
1. [BREAKING CHANGE] Jupyter Notebook Server is disabled by default. A new script (c:\dsvm\tools\setup\JupyterSetPasswordAndStart.cmd) has been created to help you set the Jupyter password and start the Jupyter server. This is a one time process. There is a convenient shortcut on the desktop that you can double click to do this operation. You may have to wait a few seconds after setting the password before accessing Jupyter from your browser.
2. The following are the major new software on the VM:
- Microsoft Cognitive Toolkit 2.0 (also known as CNTK). Now a Python interface (Python 3.4) is available to build your deep neural networks. Comes with lots of samples, notebooks and hands-on labs.
- Weka 3 - An open source Visual Data Mining Software in Java.
- Apache Drill - An open source schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage. Supports ODBC and JDBC interfaces to enable querying NoSQL and files from standard BI tools like PowerBI, Excel, Tableau.
- eVince PDF reader
- Side-by-side install of Microsoft R Open 3.3.1 (Enhanced Open source R distribution based on and 100% compatible with R-3.3.1). This is in addition to the default R instance which is Microsoft R Server developer edition (which in turn is based on R-3.2.2). You can switch to Microsoft R Open 3.3.1 if you need to run R programs that depend on the latest R version.
- OpenJDK 1.8.0_102 : An open source implementation of Java Standard edition platform.
- A new conda environment for Python 3.4 in addition to the existing Python 2.7, Python 3.5.
- R libraries: RSQLServer library to access SQL Server databases through the dplyr interface; dplyrXdf library to work with Microsoft R Xdf files using the dplyr paradigm.
- Mozilla Firefox browser. Jupyter notebook software is better tested and supported on Firefox. If you are see issues with running notebooks on default IE browser, please retry with Firefox.
- Visual Studio Code - An open source code editor supporting several popular programming languages and extensions. Particularly useful for editing / previewing markdown and a lightweight client to work with Git repositories.
- Libraries to access objects stored in Azure Data Lake Store (WebHdfs) from Microsoft R Server using the R functions RxHdfsFileSystem, RxTextData.
We have a few more new samples. They are can be found on the Jupyter notebooks home (c:\dsvm\notebooks on the VM instance) when you login to the Jupyter server on the new data science VM. Non-notebook samples are found in c:\dsvm\samples. You can also download detailed labs for Cortana Intelligence Advanced Analytics labs and Microsoft R Server from shortcuts found on desktop or from c:\dsvm\samples\Labs.
-
Link
If you are already using or are planning to use the Data Science Virtual Machine (DSVM), you are definitely not alone.
A rapidly growing number of people and organizations globally from across different industries with diverse skills and requirements have started to use the DSVM. This is quickly expanding the number and types of problems that people are trying to solve using the DSVM. It is our intention to build and grow this community and promote the healthy sustainable conversations, community based problem solving and knowledge sharing that Microsoft forums have always been known for. The DSVM team is committed to being actively engaged in the conversations and responding whenever possible and required.
The forum is intended to be the central location for our customers to interact with their peers and the DSVM team. This dialogue greatly helps not only the community and new users but also the DSVM team to make the right decisions about what direction to take the product, in future releases.
We encourage you to ask a question today.
Click to Download the 2-page DSVM Handout as PDF.