Skip to content

With this library, you can embed Python to your Java or Scala project. The main purpose of this library is to use Python libraries from Java or Scala.

License

Notifications You must be signed in to change notification settings

bytedeco/javacpp-embedded-python

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

67 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

JavaCPP Embedded Python

With this library, you can embed Python to your Java or Scala project. This library is a wrapper of javacpp-presets/cpython. The main purpose of this library is to use Python libraries from Java or Scala.

Apache Maven and sbt

I have not uploaded this library to the Apache Maven Central Repository yet. You have to do mvn install.

Apache Maven

<dependency>
    <groupId>org.bytedeco</groupId>
    <artifactId>javacpp-embedded-python</artifactId>
    <version>1.0.0-SNAPSHOT</version>
</dependency>
<dependency>
    <groupId>org.bytedeco</groupId>
    <artifactId>numpy-platform</artifactId>
    <version>1.20.1-1.5.5</version>
</dependency>

sbt

libraryDependencies += "org.bytedeco" % "javacpp-embedded-python" % "1.0.0-SNAPSHOT"
libraryDependencies += "org.bytedeco" % "numpy-platform" % "1.20.1-1.5.5"

JavaCPP 1.5.3 or later is supported. If you want to use Python 3.7, replace numpy-platform version to 1.19.1-1.5.4.

Javadoc

http://bytedeco.org/javacpp-embedded-python/apidocs/

Usage

You can put the global variable a.

Python.put("a", 1);

Execute the Python code.

Python.exec("b = a + 2");

Get the global variable b.

long b = Python.get("b");

You can add a built-in global function to Python. The scala.Function2 interface comes from scala-java8-compat library. If you don't need the return value, please return null. This will return None in Python.

import scala.Function2;

Python.put("f", (Function2<Long, Long, Long>) (a, b) -> a + b);
long v = Python.eval("f(1, 2)");

You can also use a Numpy np.ndarray and convert it to a Java array.

NpNdarrayFloat ndary = Python.eval("np.arange(6, dtype=np.float32).reshape([2, 3])");
float[][] ary = ndary.toArray2d();

If you need a Python library, please use the Pip class.

Pip.install("pandas");

If you want to use the local Python files, use sys.path.append("your_src_dir") in Python.

Type mappings

Python to Java

Python Java
None null
bool
scalar np.bool8
boolean
scalar np.int8 byte
scalar np.int16 short
scalar np.uint16 char
scalar np.int32 int
int
scalar np.int64
long
scalar np.float32 float
float
scalar np.float64
double
scalar np.datetime64[W, D, h, m, s, ms, us, or ns] Instant
str String
bytes
bytearray
byte[]
dict LinkedHashMap
ndarray np.int8 NpNdarrayByte
ndarray np.bool8 NpNdarrayBoolean
ndarray np.int16 NpNdarrayShort
ndarray np.uint16 NpNdarrayChar
ndarray np.int32 NpNdarrayInt
ndarray np.int64 NpNdarrayLong
ndarray np.float32 NpNdarrayFloat
ndarray np.float64 NpNdarrayDouble
ndarray np.datetime64[W, D, h, m, s, ms, us, or ns] NpNdarrayInstant
iterable ArrayList

If you want to use Pandas DataFrames, please use DataFrame.reset_index().to_dict('list'). If you are using datetimes in DataFrame, use DatetimeIndex.to_numpy().

Java to Python

Java Python
null None
boolean bool
byte
short
char
int
long
int
float
double
float
Instant np.datetime64[ns]
String str
byte[] bytes
boolean[]
NpNdarrayBoolean
np.ndarray, dtype=np.bool8
NpNdarrayByte np.ndarray, dtype=np.int8
short[]
NpNdarrayShort
np.ndarray, dtype=np.int16
char[]
NpNdarrayChar
np.ndarray, dtype=np.uint16
int[]
NpNdarrayInt
np.ndarray, dtype=np.int32
long[]
NpNdarrayLong
np.ndarray, dtype=np.int64
float[]
NpNdarrayFloat
np.ndarray, dtype=np.float32
double[]
NpNdarrayDouble
np.ndarray, dtype=np.float64
Instant[]
NpNdarrayInstant
np.ndarray, dtype=np.datetime64[ns]
java.util.Map
scala.collection.Map
dict
Object[]
Iterable
list
scala.Function0 - Function22 built-in global Python function

Value type tree

If the value type conversion fails, its value type tree is included in the Exception message.

For example, for this Java code,

HashMap<String, Object> map = new HashMap<>();
map.put("a", Arrays.asList(1, 2));
map.put("b", UUID.randomUUID());
Python.put("v", map);

you get this message. Because UUID is unsupported, you have to convert it to a String.

org.bytedeco.embeddedpython.PythonException: Cannot convert the Java object to a Python object.

Value type tree
  Map
    Map.Entry
      String
      Iterable(java.util.Arrays$ArrayList)
        Integer
        Integer
    Map.Entry
      String
      java.util.UUID  <- Unsupported

Tips

Because Python is a duck typing language, the Python value type is unclear statically. For example, people don't care about the difference between int and np.int64 scalar. Therefore, I recommend converting the Python value type before passing it to the Java side and making it clear statically. For example, use such as int(), np.array(), or bytes().

Exceptions

Python to Java

When Python code throws exceptions in Python.eval() or Python.exec(), tracebacks are printed to stderr, and PythonException is thrown in Java.

Java to Python

When Java code throws exceptions in the Java lambda, Throwable.printStackTrace() is called, and RuntimeError is thrown in Python.

Intel Math Kernel Library

If you are using Intel CPU, add this dependency.

<dependency>
    <groupId>org.bytedeco</groupId>
    <artifactId>mkl-platform-redist</artifactId>
    <version>2021.1-1.5.5</version>
</dependency>

Version matrix

javacpp-embedded-python numpy-platform mkl-platform-redist CPython
1.x.x 1.18.2-1.5.3 2020.1-1.5.3 3.7.7
1.x.x 1.19.1-1.5.4 2020.3-1.5.4 3.7.9
1.x.x 1.20.1-1.5.5 2021.1-1.5.5 3.9.2

Linux problem

Because javacpp-presets/cpython has not been built correctly on Linux, you have to rebuild it. You can do it by this if you are using Ubuntu 20.04. See also https://devguide.python.org/setup/#linux for other Linux distributions. Change 1.5.5 to your JavaCPP version. javacpp-presets/cpython forgets to do apt-get build-dep python3.8.

echo 'deb-src http://archive.ubuntu.com/ubuntu/ focal main' | sudo tee -a /etc/apt/sources.list
sudo apt update
sudo apt-get build-dep python3.8
sudo apt install maven openjdk-11-jdk

git clone https://github.com/bytedeco/javacpp-presets.git
cd javacpp-presets
git checkout -b 1.5.5 refs/tags/1.5.5
cd cpython
mvn install

About

With this library, you can embed Python to your Java or Scala project. The main purpose of this library is to use Python libraries from Java or Scala.

Topics

Resources

License

Stars

Watchers

Forks

Languages