Skip to main content

Ctrl+K

Try Ray with $100 credit — Start now

Site Navigation

Get Started
Use Cases
Example Gallery
Library
Docs
Resources

Try Managed Ray

Site Navigation

Get Started
Use Cases
Example Gallery
Library
Docs
Resources

Try Managed Ray

Overview
Getting Started
Installation
Use Cases
- Ray for ML Infrastructure
Examples
Ecosystem
Ray Core
Ray Data
Ray Train
Ray Tune
Ray Serve
Ray RLlib
More Libraries
Ray Clusters
Monitoring and Debugging
Developer Guides
Glossary
Security
- Ray token authentication
Project Governance
- People

Ray Data: Scalable Data Processing for AI Workloads
ray.data.preprocessors.HashingVectorizer
ray.data.pre...

ray.data.preprocessors.HashingVectorizer.tokenization_fn#

property HashingVectorizer.tokenization_fn: Callable[[str], List[str]]#

previous

ray.data.preprocessors.HashingVectorizer.stat_computation_plan

next

ray.data.preprocessors.TorchVisionPreprocessor

On this page

HashingVectorizer.tokenization_fn

Thanks for the feedback!

Was this helpful?

Yes

No

Feedback

Submit

© Copyright 2026, The Ray Team.

Created using Sphinx 7.3.7.

Built with the PyData Sphinx Theme 0.14.1.