Built-in preprocessing tools
============================

Hooks
------

Moses Normalizer
^^^^^^^^^^^^^^^^^
.. autoclass:: podium.preproc.MosesNormalizer
   :members:
   :no-undoc-members:


Regex Replace
^^^^^^^^^^^^^^
.. autoclass:: podium.preproc.RegexReplace
   :members:
   :no-undoc-members:


Keyword Extractor
^^^^^^^^^^^^^^^^^
.. autoclass:: podium.preproc.KeywordExtractor
   :members:
   :no-undoc-members:


Text Cleanup
^^^^^^^^^^^^
.. autoclass:: podium.preproc.TextCleanUp
   :members:
   :no-undoc-members:

NLTK Stemmer
^^^^^^^^^^^^
.. autoclass:: podium.preproc.NLTKStemmer
   :members:
   :no-undoc-members:

Spacy Lemmatizer
^^^^^^^^^^^^^^^^^
.. autoclass:: podium.preproc.SpacyLemmatizer
   :members:
   :no-undoc-members:

Stop words
----------

.. automodule:: podium.preproc.stop_words
   :members:
   :no-undoc-members:
   :show-inheritance:


Sentencizers
------------

.. automodule:: podium.preproc.sentencizers
   :members:
   :no-undoc-members:
   :show-inheritance:

Tokenizers
-----------

.. automodule:: podium.preproc.tokenizers
   :members:
   :no-undoc-members:
   :show-inheritance:

Utilities
----------

.. automodule:: podium.preproc.utils
   :members:
   :no-undoc-members:
   :show-inheritance:

Module contents
---------------

.. automodule:: podium.preproc
   :members:
   :no-undoc-members:
   :show-inheritance: