This needs to be authenticated, so the nfi user’s credentials created during the aen server install must be used After successfully completing the installation script, the installer creates the administrator account—aen_srvc_acct user—and assigns it a password. Setting variables and changing permissions running the aen compute installer configuring your compute node (s) what’s next Make the custom install folder owned by $aen_srvc_acct Make a symlink from /opt/wakari to /data/aen Move the folder from /projects to your chosen custom location
Make a symlink from /projects to /data/aen/projects. $ exportmongo_url=mongodb://<username>:<password>@<host>:<port>/ $ exportmongo_db=<database_name> continue the installation process Install spark # the easiest way to install spark is with cloudera cdh You will use yarn as a resource manager After installing cloudera cdh, install spark Spark comes with a pyspark shell.
#!/bin/bashfirst_cmd=$1if['bash'==$1];thenshiftexporthome= ~ exportshell= /bin/bash exportpath=$path:/opt/wakari/anaconda/bin bash $@elseexec$@fi If the /projects folder resides on an nfsv3 volume and you have a setup with several compute nodes, aen will create local users with a different uid on each node.
WATCH
