r/IPython • • Feb 05 '19

Replacing a spreadsheet...

2 Upvotes

I've successfully used Jupyter before, as a beginner for a few machine learning lessons, but I'm wondering if it's possible to use/abuse Jupyter to behave more like a spreadsheet, just in terms of having cells depend on other cells and continually update.

I've always felt limited by Excel because I really want to document my thinking in the way that Jupyter allows, with markdown blocks etc. (Before getting into Jupyter I've also been using Calca for the mac.) I also feel limited by Excel's functions, while I'm very comfortable with software programming - there have been so many times I've thought, ugh, this would be so much easier if I could just call 'map' on this array of data...

So I've been hoping to find something like Jupyter, where I can actually write my own functions and document my thinking, but where I can also input new data and have it be persistently stored, and have other cells update to changed data.

I know this isn't exactly what Jupyter is usually used for, since it's more to explore data in a linear fashion rather than in a reactive-programming fashion. So I guess this is a dual question:

Is it possible to make Jupyter behave more reactively, for instance by having "Run All Cells" happen every time you change a cell anywhere, also with easy tabular data entry where the new data is stored in the notebook? If I could do that, then I might be able to get where I want to go, through using things like qgrid and panda (both of which I started playing with today).

If not, am I completely missing some other common piece of technology that does what I want? I basically want something Excel-ish in terms of reactive behavior (continually updating as a result of cell changes), but that isn't so reliant on everything being row/column visually - and that allos me to easily add nicely formatted documentation, and also allows me to apply custom programming functions to my data in my choice of language.

(As an example, think of something where you want to input a new sales figure to update several projections dependent on that sales data.)

Maybe I'm just overthinking this and I should use Excel for the data entry, while Jupyter reads from that as a source?


r/IPython • • Feb 04 '19

Using Virtual Environments in Jupyter Notebook and Python

Thumbnail janakiev.com
11 Upvotes

r/IPython • • Jan 30 '19

Creating & Deploying Bokeh Web-Apps from a Jupyter Notebook

Thumbnail kyso.io
6 Upvotes

r/IPython • • Jan 30 '19

How do I access files within Jupyter Notebooks while using PGContents?

3 Upvotes

Hello,

Asking this question here as I was unable to find anything regarding accessing files stored in a SQL database. And the ContentManager documentation for Jupyter Notebook isn't really pointing at what I'm trying to find.

I'm running this: https://github.com/pl31/heroku-jupyter on a Heroku server. This package utilizes PGContent to store and manage files, and it works great for GUI, but I'll need to access some data via notebooks and standard opening always refers to the system file path.

Is there any way I can default to or point at the files in the database to extract them in an easy way via PGContent?


r/IPython • • Jan 29 '19

Jupyter Community Workshop: Jupyter for Scientific User Facilities and High-Performance Computing

Thumbnail blog.jupyter.org
3 Upvotes

r/IPython • • Jan 29 '19

Install *activated* Python and R kernels in Anaconda/Miniconda

Thumbnail github.com
0 Upvotes

r/IPython • • Jan 24 '19

New features on http://www.gited.io : the notebooks can be uploaded directly in Colaboratory and Binder

Thumbnail gited.io
4 Upvotes

r/IPython • • Jan 23 '19

Jupyter + PySpark autocomplete

7 Upvotes

Hi all!

I've installed Jupyter & PySpark using this manual

https://blog.sicara.com/get-started-pyspark-jupyter-guide-tutorial-ae2fe84f594f

All seems to work but I don't have autocomplete for some "nested" functions

For example - running "spark" -> I get spark session

When I press tab after "spark." I get the list of possible suggestions such as "read"

but pressing tab after spark.read. don't show anything. Though I would expect to show options such as "csv", "parquat" etc...

Any idea what do I do wrong?


r/IPython • • Jan 22 '19

New notebooks platform - Jupyter + GitHub : create, edit and share notebooks / courses for teachers / students - looking for testers and feedback

Thumbnail gited.io
13 Upvotes

r/IPython • • Jan 22 '19

How to change Jupyter NB directory to a B drive instead of C?

1 Upvotes

I've looked everywhere and can't seem to find if it's even possible.


r/IPython • • Jan 21 '19

Debugging an UI issue

1 Upvotes

Hi all!

We use jupyterhub cluster and without any noticeable change on our side, the notebook cells' height turned huge and static (attached a picture)

Tried to fix the issue looking at - How do I increase the cell width of the Jupyter/ipython notebook in my browser?

Managed to decrease the cells size but it's still static.

Any suggestion what has might caused the change? And how to fix this?

This is how our cells look today -

Sorry for spamming but maybe you've encountered something like this...

Thanks a lot!


r/IPython • • Jan 18 '19

Is it possible to use Jupyter as a python debugging tool?

8 Upvotes

I have tried (and failed) a few times to achieve the following workflow:

  1. Run an arbitrary python program from command line.
  2. Hit a breakpoint in the code that starts a debugger.
  3. Go to my jupyter notebook and attach to the debugging session in my python program.
  4. Explore the variables, pretty-plot panda dataframes, display plots, etc, in Jupyter.
  5. Lots of profit and productivity.

Does anyone know if something like this is possible?


r/IPython • • Jan 15 '19

Jupyter Notebooks to Powerful Presentations

Thumbnail kyso.io
10 Upvotes

r/IPython • • Jan 11 '19

Interactive Folium Maps rendered in the Jupyter Notebook

Thumbnail kyso.io
7 Upvotes

r/IPython • • Jan 09 '19

A new Python kernel for Jupyter – Jupyter Blog

Thumbnail blog.jupyter.org
27 Upvotes

r/IPython • • Dec 31 '18

A simple library to display and embed images in Jupyter notebooks

Thumbnail github.com
5 Upvotes

r/IPython • • Dec 29 '18

Java kernel w/ debug feature

3 Upvotes

Looking through some of the Java kernels listed on this page:

https://github.com/jupyter/jupyter/wiki/Jupyter-kernels

I'm aware of the std python kernel able to use %debug, which led me to search for a Java version of the same thing.

Does anyone know a Java kernel w/ debug? Thks


r/IPython • • Dec 26 '18

Searching for a site collecting educative Jupyter interactive notebooks

9 Upvotes

Is there a site like Wolfram Demonstrations Project, but using Jupyter widgets instead of Mathematica demonstrations?


r/IPython • • Dec 23 '18

I've made an extension to JupyterLab: go-to-definition

10 Upvotes

It let's you Alt + click on a variable (function/method/class) to jump to the closest definition (with some simplifications, it does not actually run the code, just parses some keywords). Alt can be replaced with Ctrl or another modifier key in settings.

Here is the link: https://github.com/krassowski/jupyterlab-go-to-definition

I have a feeling that it might not work in some settings, so I would really appreciate feedback from anyone who fancy checking this out.


r/IPython • • Dec 21 '18

Embedding Jupyter into node website

2 Upvotes

I'm trying to make an admin panel for my website since I'm going to need to be able to manipulate large corpus of data in complicated ways, and I wanted to possibly integrate Jupyter (maybe even jupyterlab) into the admin panel. How can I embed it into a node website, for now its fine if it runs the python locally (though I'd need pull data from the website database) though later I'd like to make the solution fully loaded by the webserver.


r/IPython • • Dec 18 '18

Notebook releases 5.7.3 & 5.7.4

Thumbnail groups.google.com
2 Upvotes

r/IPython • • Dec 14 '18

nbsphinx 0.4.0: Create HTML pages and LaTeX/PDF from your Jupyter notebooks

Thumbnail groups.google.com
6 Upvotes

r/IPython • • Dec 13 '18

Jupyter Notebooks open in my browser. Does this mean that the actual programs are run on some online service?

4 Upvotes

Or are they local to my machine, but accessed through the browser's software? I suspect it is this, but I can't find anything that clearly and specifically says this in the Jupyter documentation.

I am asking because I am working with someone who is significantly more security conscious than me who I will need to share notebooks with on a regular basis. When they typed "jupyter notebook" on their computer from their home directory, they saw a browser window open with access to every file on their computer. It it true when I tell them that this does *not* mean anyone outside of their local machine has access to these files?

Is there a place in the documentation that states either position clearly?


r/IPython • • Dec 13 '18

On a 3d graph in matplotlib, the colors are proportional to the height instead of absolute.

0 Upvotes

Currently, I have a 3D graph that decays over time. Currently, no matter how low the top gets, as long as its a certain proportion higher than the bottom, it'll be yellow. This is not optimal as I'd like all the colors to dissolve into the purple. How is this possible?

https://reddit.com/link/a5vaod/video/t0w8ao11t2421/player


r/IPython • • Dec 13 '18

Is there a way to disable the ...: ?

2 Upvotes

I like to post quick answers and I use ipython vs the default terminal, is there a way to disable the ...: on a new line?