Loading docs/_docs/compose/publishing.md +5 −3 Original line number Diff line number Diff line Loading @@ -16,9 +16,11 @@ Before running the publication, ensure that the test dataset exists in `ESGF_DAT ```sh mkdir -p "$ESGF_DATA/test" wget -O "$ESGF_DATA/test/sftlf.nc" http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/externals/sftlf.nc wget -O "$ESGF_DATA/test/sftlf.nc" https://github.com/ESGF/esgf-ansible/releases/download/4.0.0-alpha1/sftlf.nc ``` https://github.com/ESGF/esgf-ansible/releases/download/4.0.0-alpha1/sftlf.nc ### Start a publisher container instance For an ad-hoc publish, create an instance of the publisher container to use: Loading Loading @@ -87,8 +89,8 @@ esgpublish --project test --map mapfiles/test.test.map --service fileservice --n After about a minute, the dataset and file should be returned when querying Solr: * `https://${ESGF_HOSTNAME}/solr/index.html#/datasets/query` * `https://${ESGF_HOSTNAME}/solr/index.html#/files/query` - `https://${ESGF_HOSTNAME}/solr/index.html#/datasets/query` - `https://${ESGF_HOSTNAME}/solr/index.html#/files/query` Additionally, they should be returned when initiating a search from the CoG user interface, if the project has searching enabled: `https://${ESGF_HOSTNAME}/search/testproject/`. docs/_docs/kubernetes/minikube.md +7 −10 Original line number Diff line number Diff line Loading @@ -70,7 +70,6 @@ helm upgrade ingress stable/nginx-ingress \ kubectl -n kube-system wait --for condition=ready pods -l "release=ingress" --timeout 300s ``` ## Configure and deploy ESGF components Configuration is very similar to [Docker Compose](../../compose/quick-start/#configure-environment): Loading Loading @@ -99,13 +98,12 @@ using `minikube dashboard`. Once all the containers are running, visit `https://$ESGF_HOSTNAME` to see the CoG interface. Try the following as a basic test of functionality: * Log in with the `rootAdmin` account from CoG (OpenID `https://$ESGF_HOSTNAME/esgf-idp/openid/rootAdmin`) - Log in with the `rootAdmin` account from CoG (OpenID `https://$ESGF_HOSTNAME/esgf-idp/openid/rootAdmin`) using the password from the `my-node-esgf-node-secrets` secret in Kubernetes, or the file `$ESGF_CONFIG/secrets/rootadmin-password` * Log in with the `rootAdmin` account from the ORP (`https://$ESGF_HOSTNAME/esg-orp`) * Check THREDDS is running at `https://$ESGF_HOSTNAME/thredds` * Check Solr is running at `https://$ESGF_HOSTNAME/solr` - Log in with the `rootAdmin` account from the ORP (`https://$ESGF_HOSTNAME/esg-orp`) - Check THREDDS is running at `https://$ESGF_HOSTNAME/thredds` - Check Solr is running at `https://$ESGF_HOSTNAME/solr` ## Test publication Loading @@ -123,7 +121,7 @@ $ kubectl wait --for condition=ready pods "$PUBLISHER_POD" --timeout 300s $ kubectl exec -it "$PUBLISHER_POD" /usr/local/bin/docker-entrypoint.sh bash # Download the data [publisher] $ mkdir -p /esg/data/test [publisher] $ wget -O /esg/data/test/sftlf.nc http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/externals/sftlf.nc [publisher] $ wget -O /esg/data/test/sftlf.nc https://github.com/ESGF/esgf-ansible/releases/download/4.0.0-alpha1/sftlf.nc # Fetch a certificate [publisher] $ fetch-certificate # Publish the data Loading @@ -140,7 +138,6 @@ $ kubectl scale --replicas=0 deployment my-node-esgf-node-publisher After allowing time for the data to replicate from the master to the slave, check that search is working at `https://$ESGF_HOSTNAME/search/testproject/` and that the data is accessible from THREDDS. ## Cleanup To delete the Minikube cluster, run: Loading Loading
docs/_docs/compose/publishing.md +5 −3 Original line number Diff line number Diff line Loading @@ -16,9 +16,11 @@ Before running the publication, ensure that the test dataset exists in `ESGF_DAT ```sh mkdir -p "$ESGF_DATA/test" wget -O "$ESGF_DATA/test/sftlf.nc" http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/externals/sftlf.nc wget -O "$ESGF_DATA/test/sftlf.nc" https://github.com/ESGF/esgf-ansible/releases/download/4.0.0-alpha1/sftlf.nc ``` https://github.com/ESGF/esgf-ansible/releases/download/4.0.0-alpha1/sftlf.nc ### Start a publisher container instance For an ad-hoc publish, create an instance of the publisher container to use: Loading Loading @@ -87,8 +89,8 @@ esgpublish --project test --map mapfiles/test.test.map --service fileservice --n After about a minute, the dataset and file should be returned when querying Solr: * `https://${ESGF_HOSTNAME}/solr/index.html#/datasets/query` * `https://${ESGF_HOSTNAME}/solr/index.html#/files/query` - `https://${ESGF_HOSTNAME}/solr/index.html#/datasets/query` - `https://${ESGF_HOSTNAME}/solr/index.html#/files/query` Additionally, they should be returned when initiating a search from the CoG user interface, if the project has searching enabled: `https://${ESGF_HOSTNAME}/search/testproject/`.
docs/_docs/kubernetes/minikube.md +7 −10 Original line number Diff line number Diff line Loading @@ -70,7 +70,6 @@ helm upgrade ingress stable/nginx-ingress \ kubectl -n kube-system wait --for condition=ready pods -l "release=ingress" --timeout 300s ``` ## Configure and deploy ESGF components Configuration is very similar to [Docker Compose](../../compose/quick-start/#configure-environment): Loading Loading @@ -99,13 +98,12 @@ using `minikube dashboard`. Once all the containers are running, visit `https://$ESGF_HOSTNAME` to see the CoG interface. Try the following as a basic test of functionality: * Log in with the `rootAdmin` account from CoG (OpenID `https://$ESGF_HOSTNAME/esgf-idp/openid/rootAdmin`) - Log in with the `rootAdmin` account from CoG (OpenID `https://$ESGF_HOSTNAME/esgf-idp/openid/rootAdmin`) using the password from the `my-node-esgf-node-secrets` secret in Kubernetes, or the file `$ESGF_CONFIG/secrets/rootadmin-password` * Log in with the `rootAdmin` account from the ORP (`https://$ESGF_HOSTNAME/esg-orp`) * Check THREDDS is running at `https://$ESGF_HOSTNAME/thredds` * Check Solr is running at `https://$ESGF_HOSTNAME/solr` - Log in with the `rootAdmin` account from the ORP (`https://$ESGF_HOSTNAME/esg-orp`) - Check THREDDS is running at `https://$ESGF_HOSTNAME/thredds` - Check Solr is running at `https://$ESGF_HOSTNAME/solr` ## Test publication Loading @@ -123,7 +121,7 @@ $ kubectl wait --for condition=ready pods "$PUBLISHER_POD" --timeout 300s $ kubectl exec -it "$PUBLISHER_POD" /usr/local/bin/docker-entrypoint.sh bash # Download the data [publisher] $ mkdir -p /esg/data/test [publisher] $ wget -O /esg/data/test/sftlf.nc http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/externals/sftlf.nc [publisher] $ wget -O /esg/data/test/sftlf.nc https://github.com/ESGF/esgf-ansible/releases/download/4.0.0-alpha1/sftlf.nc # Fetch a certificate [publisher] $ fetch-certificate # Publish the data Loading @@ -140,7 +138,6 @@ $ kubectl scale --replicas=0 deployment my-node-esgf-node-publisher After allowing time for the data to replicate from the master to the slave, check that search is working at `https://$ESGF_HOSTNAME/search/testproject/` and that the data is accessible from THREDDS. ## Cleanup To delete the Minikube cluster, run: Loading