DreamTeam/Valis: Difference between revisions

From Noisebridge
Jump to navigation Jump to search
No edit summary
Line 1: Line 1:
== About ==
== About ==


Valis is a shared compute resource for training machine learning models. Specifically, Valis excels at tasks that require lots of GPU compute power. Valis is intended for research and educational purposes only (not for profit).
Valis is a shared compute resource for training machine learning models. Specifically, Valis excels at tasks that require GPU compute. Valis is intended for research and educational purposes only (not for profit).


== Specs ==
== Specs ==
Line 14: Line 14:
Valis is accessed through a VPN. Follow the instructions below to receive and utilize a VPN user account.
Valis is accessed through a VPN. Follow the instructions below to receive and utilize a VPN user account.


# Let the community know about your project by sending a message to the [https://lists.noisebridge.net/mailman/listinfo/ml|ml list] or join the [[DreamTeam/Reading|Dream Team Neurohackers]] in person on Wednesday nights at 8pm.
# Let the community know about your project by sending a message to the [https://lists.noisebridge.net/mailman/listinfo/ml ml list] or join the [[DreamTeam/Reading|Dream Team Neurohackers]] in person on Wednesday nights at 8pm.
# Make a note on [[Talk:Valis]] with your GPG public key fingerprint. You will be emailed an encrypted archive containing your cert, key, OpenVPN configuration file, and OpenVPN username/password for connecting to the VPN plus a Jupyterhub username/password. Jupyterhub and OpenVPN currently use two different user access systems.
# Make a note on [[Talk:Valis]] with your GPG public key fingerprint. You will be emailed an encrypted archive containing your cert, key, OpenVPN configuration file, and OpenVPN username/password for connecting to the VPN plus a Jupyterhub username/password.
# Configure your computer to connect to our OpenVPN server. On Debian this can be configured in [https://packages.debian.org/stretch/network-manager-openvpn network-manager-openvpn]. On OS X [https://tunnelblick.net/ Tunnelblick] works well.
## Jupyterhub and OpenVPN currently use two different user access systems.
# Configure your computer to connect to our OpenVPN server
## On Debian this can be configured in [https://packages.debian.org/stretch/network-manager-openvpn network-manager-openvpn].
## On OS X [https://tunnelblick.net/ Tunnelblick] works well.
# Connect to the VPN and run [[#verifications]].
# Connect to the VPN and run [[#verifications]].
# If the verifications pass, then continue. If not, troubleshoot!
# If the verifications pass, then continue. If not, see [[#Debugging/FAQ]].
# Change your VPN password [https://pfsense.localdomain here]. Please note that all TLS certs on the internal network are signed by an internal CA (your browser will not trust this CA, nor the certs that it has signed by default).
# Change your VPN password [https://pfsense.localdomain here].
## Please note that all TLS certs on the internal network are signed by an internal CA. Your browser will not trust this CA, nor the certs that it has signed by default.
# Login to our [https://jupyterhub.valis.ml Jupyterhub instance].
# Login to our [https://jupyterhub.valis.ml Jupyterhub instance].
# Open a terminal session and change your [[#change your linux user password]].
# Open a terminal session and [[#change your linux user password]].
# Open a Python 3 notebook and being hacking.
# Open a Python 3 notebook and being hacking.


Line 37: Line 41:




== Debugging ==
== Debugging/FAQ ==
 
== Services ==
 
{| class="wikitable"
! scope="col"| URL
! scope="col"| Comments
|-
| https://pfsense.localdomain
| Firewall, DNS, OpenVPN server, etc.
|-
| https://jupyterhub.valis.ml
| Notebook server
|-
| https://chronograf.valis.ml
| Metrics dashboards
|}

Revision as of 20:36, 10 March 2018

About

Valis is a shared compute resource for training machine learning models. Specifically, Valis excels at tasks that require GPU compute. Valis is intended for research and educational purposes only (not for profit).

Specs

  • Intel 4114 10-core CPU
  • 4x Nvidia Titan V GPUs
  • 196GB ECC RAM
  • 2x 2TB SSDs

Access

Valis is accessed through a VPN. Follow the instructions below to receive and utilize a VPN user account.

  1. Let the community know about your project by sending a message to the ml list or join the Dream Team Neurohackers in person on Wednesday nights at 8pm.
  2. Make a note on Talk:Valis with your GPG public key fingerprint. You will be emailed an encrypted archive containing your cert, key, OpenVPN configuration file, and OpenVPN username/password for connecting to the VPN plus a Jupyterhub username/password.
    1. Jupyterhub and OpenVPN currently use two different user access systems.
  3. Configure your computer to connect to our OpenVPN server
    1. On Debian this can be configured in network-manager-openvpn.
    2. On OS X Tunnelblick works well.
  4. Connect to the VPN and run #verifications.
  5. If the verifications pass, then continue. If not, see #Debugging/FAQ.
  6. Change your VPN password here.
    1. Please note that all TLS certs on the internal network are signed by an internal CA. Your browser will not trust this CA, nor the certs that it has signed by default.
  7. Login to our Jupyterhub instance.
  8. Open a terminal session and #change your linux user password.
  9. Open a Python 3 notebook and being hacking.

verifications

$ ping 172.16.1.1 # DNS server
$ ping 172.16.1.2 # Valis
$ ping valis.ml   # Also Valis, demonstrates your using the internal DNS

change your linux user password

$ passwd

Scheduling

Notes on how/what to check before running a process


Debugging/FAQ

Services

URL Comments
https://pfsense.localdomain Firewall, DNS, OpenVPN server, etc.
https://jupyterhub.valis.ml Notebook server
https://chronograf.valis.ml Metrics dashboards
Retrieved from "https://main-wiki.extremist.software/index.php?title=DreamTeam/Valis&oldid=65343"