yohei-a https://blog.hatena.ne.jp/yohei-a/ ablog https://yohei-a.hatenablog.jp/ Spark PySpark では Java の正規表現を使う Regex in pyspark internally uses java regex.One of the common issue with regex is escaping backslash as it uses java regex and we will pass raw python string to spark.sql we can see it with a sample example \d represents digit in regex.Let us use spark regexp_extract to matc… 190 <iframe src="https://hatenablog-parts.com/embed?url=https%3A%2F%2Fyohei-a.hatenablog.jp%2Fentry%2F20210612%2F1623470162" title="PySpark は Java の正規表現記法を使う - ablog" class="embed-card embed-blogcard" scrolling="no" frameborder="0" style="display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;"></iframe> Hatena Blog https://hatena.blog 2021-06-12 12:56:02 rich https://yohei-a.hatenablog.jp/entry/20210612/1623470162 1.0 100%