Recommendations#
Package Speedup Best Practices#
tidy3d is a pretty big project already, and will get bigger. We want to optimise the performance of the codebase throughout the multiple operations that we perform.
We want to improve the speed of the project import and there are a few techniques to do this which are inherent to the way we write our code.
We have already begun facing these type of code-speed issues as first raised here, here
So when we import dependencies inside our code-base in particular where these are used, we will try to do the following:
from mypackage import just_what_I_need
instead of
import mypackage
This is because the latter will import the entire package, which is not necessary and will slow down the code.
Managing Optional Dependencies On-The-Fly#
If you look within pyproject.toml, it is possible to see that we have different packages relating to different functionalities that are optional.
Some examples from these are [vtk, jax, trimesh, gdstk, gdspy] etc. What we want to do is improve the import speed of the core-package in order to minimise small core operations. As we scale into a bigger package, decoupling these type of imports from the total pacakge import is essential.
Benchmarking Package Import#
We want to make the tidy3d package be as light as possible for a given set of operations. As such, it is important to understand exactly where a given set of operations is expending computational power.
We have a set of utilties to verify this.
poetry run tidy3d develop benchmark-timing-operations