What happened?
The string expression strip() treats lower-case "f" as white space and strips it (left and right) from the result.
Minimal example:
import ibis
con = ibis.pyspark.connect(session=spark)
df = spark.createDataFrame([
("ffXXXff ", ),
("fXXXf", ),
("XXXff", ),
("ffXXX", ),
("ffffXXXffff", ),
("XXX", ),
("FFXXXff", ),
], schema="x string")
df.createOrReplaceTempView("temp")
t = con.table("temp")
t.mutate(x_clean=t.x.strip()).execute()What version of ibis are you using?
11.0.0
What backend(s) are you using, if any?
pyspark
Relevant log output
Code of Conduct
What happened?
The string expression
strip()treats lower-case "f" as white space and strips it (left and right) from the result.Minimal example:
What version of ibis are you using?
11.0.0
What backend(s) are you using, if any?
pyspark
Relevant log output
Code of Conduct