Jupyter: deploy from local to cloud environment? - google-colaboratory

I have a personnal IA project that requires a good computing power (training text recognition EasyOCR with new data).
It takes too much time to train (even more without CUDA GPU optimisation which I have difficulties to set up).
So I want to use Google Colab.
Problem, I don't know how to pass my project and make it work on Google Colab, I have hundreds of images and it ask me to accept every dowload ! And I can't download folder with stuff on it !
How can I pass a .zip project folder or just a project folder and make it works on a notebook ? (like Google Colab)

#Github Settings -> SSH and GPG keys -> Developers settings -> Personnal Access Tokens
!git clone https://USERNAME:TOKEN#github.com/USERNAME/REPOSITORY.git

Related

How to open Google Colab files in Neovim?

I am looking for a way to open Google Colab files in Neovim. I am basically trying to figure out a way to connect the two platforms since I have to work on Google Colab for some CUDA related assignment stuff and I just love Neovim, By doing this, I would also be able to use Neovim cheatsheets, Github Copilot and other productivity tools.
Any advice that would get me a step closer would be highly appreciated

Google Colab files are gone

Just spent like 8 hours coding in colab. I coded many python files and saved them on this files tab, under sample data but not in sample data. Got off and came back reopened the browser and all my files are gone!
Please help.
I guess this question is more about venting, right?!
Because there is nothing to do, as far as I know.
Obvious tip for next time, use Google Drive to store your scripts.
Playground only provides temporary session, so in order to save any changes, notebook files must be saved.
The easiest way to save Colab notebook is to save it in your Google Drive. Click File > Save a copy in Drive. Once you saved a copy of this tutorial, you can open it from your Google Drive or Colab dashboard
To mount Google Drive, run the below code and go to the link to retrieve the authorization code
from google.colab import drive
drive.mount('/content/gdrive')
Once mounted successfully, your entire Google Drive files should be accessible under /content/gdrive/My\ Drive/
!ls /content/gdrive/My\ Drive
How to use Google Colab
Well this might be a little late but...I just had the same issue as you and I fixed it. I just disconnected/reconnected my Google Drive and refreshed the browser. There is that folder icon in the folder tree with the google drive icon on it. Worth a shot...

How to upload a package to private universe (without rebuilding it)?

I have DCOS running in a network without Internet access. I cannot copy files from an internet connected machine to the isolated network. There is a local universe running in DCOS.
Is it possible to upload a package to the local universe without having to rebuild the universe completely (with all existing packages) and if so, how do I do this?
Unfortunately this is not possible yet. You'll have to rebuild the private Universe.

write auto backup system on a pen drive

I'm trying to write a backup system on a pen drive (flash/ CD / DVD, YouNameIt).
The System need to able to run automatically upon connection to a Drive (end goal and OS!) find set folder and copy anything and paste on the drive.
and as a bonus it will be awesome to eject on completion (plug and play and remove)!
OK! this is my challenge and I have no idea where to begin.
I'm open for suggestions:
like what is the best language use what ways are the best way to good. personal tips/ recommendations, thing I should avoid! pro tips etc.
ps: security == a personal computer! System I have access to are Windows 8, Linux Ubuntu, Android ICS.
//Bardia 'Luviz' Jedi

automate setup of IBM RAD and Websphere

In a project we a forced to use IBM RAD and Webspher Application Server (6.1).
Setting up the development environment is currently described in about 10 pages of wiki documentation and takes about a day if you don't do any mistake. The main parts are:
Installing the IBM Installer;
Use it to install RAD
Install a patch to the Installer;
use it to install half a dozen patches to RAD
create a network drive pointing to ...
checkout project source to ...
install WAS
configure the a WAS instance with two jdbc drivers, 6 datasources, a queue ...
I think you get the idea
I'd like to automate that process (or at lest 95% of it) to something like.
start script x.
On prompt enter a directory with at least yGB of memory available.
Get yourself a cup of coffee
start working.
What are the proper tools to get this working? Should I use something like puppet and chef? Or is that overkill and I can just zip the installation directory and change 2 registry entries?
Has anybody experience with this? Any pointers to get started?
You can script the configuration of WAS using wsadmin:
http://pic.dhe.ibm.com/infocenter/wasinfo/v6r1/index.jsp?topic=%2Fcom.ibm.websphere.base.doc%2Finfo%2Faes%2Fae%2Fwelc6topscripting.html
It is some effort to learn how to do so but in the end it saves a lot of time. You need to use Jython or Jacl to do so.
WAS profiles can be created headless with a response file. Use manageprofiles.bat in bin directory of WAS to do so.
Regarding RAD installation you can install the IBM Installation Manager version you need to install the patches right away and then install everything in one shot. Add the fixes you need as Repositiories right from the beginning. The fixes will be installed instead of the old versions in this case. You should have the base images and all fixes on the local disk to do so.
The installation of RAD itself can also run in headless mode but I don't have any experience in doing this.
The configuration of the RAD workspace is the next thing you want to automate. This is not so simple to do. The simplest thing you can do is to export the workspace preferences of a workspace that contains all settings to an eclipse preference file (.epf). File -> Export
This is not a complete solution but may help you a bit. Be sure to keep all settings in just one file and import that into a fresh workspace.
Use Notepad++ TextFX plugin to sort the settings in the epf file. You can then figure out which settings you need just by looking at them.
More control over the workspace settings and automated conifiguration requires accessing eclipse internal APIs and some coding.
Regarding the the project sources it depends on the SCM you are using.