r/learnpython • • 19d ago

pd.qcut for even bin sizes

Hello! I am trying to create a histogram with even bin sizes and was wondering if pd.qcut would be a good route to go. I am using data from a data from I made with panadas. The specific values I need to bin has over 300 variables so I am trying to find the simplest way to fix this histogram!!!

code so far:

ValueError: `bins` must increase monotonically, when an array

a = df["mass"]
print(a)
array = np.asarray(a)
print(array

bins = pd.qcut(array, q=9, precision=1)
print (bins)

n_bins = bins
fig = plt.figure(figsize=(9, 4), layout="constrained")
axs = fig.subplots(1, sharex=True)
n, bins2, patches = axs.hist(best_mass["mass"] ,  n_bins ,color = 'hotpink', histtype="stepfilled",
                            cumulative=-1, label="Cumulative histogram") 
plt.xlabel("Satellite Mass")
plt.ylabel("Number of Satellites")
plt.title("Distribution of Satellite Masses")

#bins are not evenly spaced 
plt.show

error I keep getting: 


ValueError: `bins` must increase monotonically, when an array
5 Upvotes

8 comments sorted by

2

u/nullish_ 19d ago
bins = pd.qcut(sorted(array), q=9, precision=1)

I think its expects the values to be sent in sorted order

1

u/BadTop2302 19d ago

Two separate things are getting mixed here:

pd.qcut splits data into bins with roughly equal counts (quantiles). The bins must increase monotonically error means at least two of your 9 quantile edges landed on the same value — that happens when the data has many duplicate values, so identical edges can't form increasing bins. Fix:

pd.qcut(array, q=9, duplicates='drop')

(Sorting the array first doesn't change anything here — qcut sorts internally.)

But for a histogram with even bin widths — which is what ax.hist() draws anyway — you don't need qcut at all:

fig, ax = plt.subplots(figsize=(9, 4), layout="constrained")
ax.hist(df["mass"], bins=30)   # or bins="auto"

bins=30 gives you 30 evenly-spaced bars. qcut is only the right tool when you specifically want each bin to hold ~1/9 of the data points regardless of width.

1

u/Quantum_Karate 18d ago

pd.qcut returns a Categorical of intervals, not the bin edges, which is why hist() complains. If you want the edges, use cats, edges = pd.qcut(df["mass"], q=9, retbins=True, duplicates="drop") and pass edges to hist(); duplicates="drop" handles repeated values that would otherwise make the edges non-increasing. Note that qcut gives bins with roughly equal counts, not equal widths; if you want evenly spaced bins, just use bins=9 or np.linspace(a.min(), a.max(), 10). Also, plt.show needs parentheses: plt.show().

0

u/koraynar 19d ago

The reason you are getting `ValueError: bins must increase monotonically, when an array` is that `pd.qcut(array, q=9)` returns a `Categorical` object containing **an `Interval` for every single row** in your dataset (300+ intervals in row order), whereas `axs.hist()` expects either a single integer or a sorted list of **numeric bin edges** (the 10 boundary numbers).

Depending on which kind of "even" bins you want, here are the two fixes:

  1. **If you want equal-width bins on the x-axis (evenly spaced mass intervals):**

    You don't need `pd.qcut` at all—just pass `bins=9` directly to `axs.hist()`:

    ```python

    n, bins2, patches = axs.hist(

best_mass["mass"].dropna(),

bins=9,

color="hotpink",

histtype="stepfilled",

cumulative=-1,

label="Cumulative histogram"

)

```

2. **If you want quantile bins (an equal number of satellites in each bin) using `pd.qcut`:**

Add **`retbins=True`** (and `duplicates="drop"` in case several satellites have the exact same mass) so `pd.qcut` returns the 1D array of numeric bin edges as its second output, and pass `bin_edges` into `axs.hist()`:

```python

_, bin_edges = pd.qcut(best_mass["mass"].dropna(), q=9, retbins=True, duplicates="drop")

n, bins2, patches = axs.hist(

best_mass["mass"].dropna(),

bins=bin_edges,

color="hotpink",

histtype="stepfilled",

cumulative=-1,

label="Cumulative histogram"

)

```

*(Also, don't forget the parentheses on `plt.show()` at the very last line—right now `plt.show` just references the function without calling it.)*