-
Notifications
You must be signed in to change notification settings - Fork 28.7k
[SPARK-52889][PYTHON] Implement the current_time function in PySpark #51584
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This PR is waiting for the corresponding Scala functions PR: #51574.
Scala function PR is merged: #51574. Continuing the work on PySpark. |
Thank you, @uros-db . According to the PR title, I converted this to |
@zhengruifeng Please review. cc @MaxGekk |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, LGTM. Thank you, @uros-db .
cc @peter-toth |
Conflicts resolved. The CI failure (test_crossvalidator_on_pipeline) doesn't look related to my changes. Ready to merge. @dongjoon-hyun @HyukjinKwon @zhengruifeng |
merged to master |
What changes were proposed in this pull request?
Implement the
current_time
function in PySpark & PySpark Connect API.Why are the changes needed?
Expand API support for the
current_time
function.Does this PR introduce any user-facing change?
Yes, the new function is now available in Python API.
How was this patch tested?
Added appropriate Python function tests.
Was this patch authored or co-authored using generative AI tooling?
No.