sort a 1 row DataFrame with object panics

[gab23r]

Checks

• I have checked that this issue has not already been reported.
• I have confirmed this bug exists on the latest version of Polars.

Reproducible example

import polars as pl

pl.DataFrame({"a": [0], "obj": [object()]}).sort("a")
# thread '<unnamed>' panicked at crates/polars-core/src/scalar/mod.rs:55:92:
# called `Result::unwrap()` on an `Err` value: SchemaMismatch(ErrString("expected object"))


pl.DataFrame({"a": [0, 1], "obj": [object(), object()]}).sort("a") # works 

Log output

No response

Issue description

Panic when filtering a 1 row DataFrame containing objects, even if filtering on non-object column

Expected behavior

No panics, the dataframe stays the same

Installed versions

--------Version info---------
Polars:              1.14.0
Index type:          UInt32
Platform:            macOS-14.1.1-x86_64-i386-64bit
Python:              3.12.5 (main, Aug 14 2024, 05:07:52) [Clang 18.1.8 ]
LTS CPU:             False

----Optional dependencies----
adbc_driver_manager  <not installed>
altair               5.4.1
boto3                <not installed>
cloudpickle          <not installed>
connectorx           <not installed>
deltalake            <not installed>
fastexcel            0.12.0
fsspec               <not installed>
gevent               <not installed>
google.auth          <not installed>
great_tables         <not installed>
matplotlib           3.9.2
nest_asyncio         1.6.0
numpy                1.26.0
openpyxl             3.1.2
pandas               2.1.1
pyarrow              17.0.0
pydantic             2.8.2
pyiceberg            <not installed>
sqlalchemy           <not installed>
torch                <not installed>
xlsx2csv             0.8.2
xlsxwriter           <not installed>

[gab23r]

I hit this bug in another way. This this another MRE, if it helps:

df = pl.DataFrame({"a": 1, "obj": [object()]})
df.join(df, on = "a")