Sorry about this issue. We have not had a chance to validate sparkmagic on the Windows DSVM and hence do not support it yet. We do have it on our Ubuntu Data Science VM. Here is some info that may help you do similar thing on the Windows 2016 DSVM.
The kernel definitions are located in c:\programdata\jupyter\kernels directory on Windows 2016 DSVM.
In c:\programdata\jupyter\kernels create a directory for the kernel definition of the remote HDInsight Spark kernel. Create the kernel.json in that directory. Pasting what we have on the Ubuntu Datascience VM. You can use this with some tweaks:
{"argv":["/anaconda/envs/py35/bin/python","-m","sparkmagic.kernels.pyspark3kernel.pyspark3kernel", "-f", "{connection_file}"],
"display_name": "Python 3 Spark - HDInsight"
}
You have to change python exe's path to "/anaconda/envs/py35/python" (There is no bin in the Windows Path to Python).
Then you can follow directions in the sparkmagic article: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apache-spark-jupyter-notebook-install-locally#configure-spark-magic-to-connect-to-hdinsight-spark-cluster
Hope this helps. We will add this to our backlog.
Please share if you are able to get it to work.
