HTMap

HTMap is a library that wraps the process of mapping Python function calls out to an HTCondor pool. It provides tools for submitting, managing, and processing the output of arbitrary functions.

Our goal is to provide as transparent an interface as possible to high-throughput computing resources so that you can spend more time thinking about your own code, and less about how to get it running on a cluster.

Running a map over a Python function is as easy as

import htmap


def double(x):
    return 2 * x


doubled = list(htmap.map(double, range(10)))
print(doubled)
# [0, 2, 4, 6, 8, 10, 12, 14, 16, 18]

If you’re just getting started, jump into the first tutorial: First Steps.

Happy mapping!

Installation

Installing HTMap

Note

Bug reports and feature requests should go on our GitHub issue tracker.

Tutorials

Tutorials on using HTMap.

Dependency Management

Information about how to manage your what your code depends on (e.g., other Python packages).

API Reference

Public API documentation.

CLI Reference

Use of the HTMap CLI.

Using HTCondor with HTMap

Tips on using HTMap with HTCondor

Tips and Tricks

Useful tips & tricks on the API.

FAQ

These questions are asked, sometimes frequently.

Settings

Documentation for the various settings.

Version History

New features, bug fixes, and known issues by version.

Contributing and Developing

How to contribute to HTMap, how to set up a development environment, how HTMap works under the hood, etc.