biweeklybudget¶

Responsive Flask/SQLAlchemy personal finance app, specifically for biweekly budgeting.
For full documentation, see http://biweeklybudget.readthedocs.io/en/latest/
For screenshots, see http://biweeklybudget.readthedocs.io/en/latest/screenshots.html
For development activity, see https://waffle.io/jantman/biweeklybudget
Overview¶
biweeklybudget is a responsive (mobile-friendly) Flask/SQLAlchemy personal finance application, specifically targeted at budgeting on a biweekly basis. This is a personal project of mine, and really only intended for my personal use. If you find it helpful, great! But this is provided as-is; I’ll happily accept pull requests if they don’t mess things up for me, but I don’t intend on working any feature requests or bug reports at this time. Sorry.
The main motivation for writing this is that I get paid every other Friday, and have for almost all of my professional life. I also essentially live paycheck-to-paycheck; what savings I have is earmarked for specific purposes, so I budget in periods identical to my pay periods. No existing financial software that I know of handles this, and many of them have thousands of Google results of people asking for it; almost everything existing budgets on calendar months. I spent many years using Google Sheets and a handful of scripts to template out budgets and reconcile transactions, but I decided it’s time to just bite the bullet and write something that isn’t a pain.
Intended Audience: This is decidedly not an end-user application. You should be familiar with Python/Flask/MySQL. If you’re going to use the automatic transaction download functionality, you should be familiar with Hashicorp Vault and how to run a reasonably secure installation of it. I personally don’t recommend running this on anything other than your own computer that you physically control, given the sensitivity of the information. I also don’t recommend making the application available to anything other than localhost, but if you do, you need to be aware of the security implications. This application is not designed to be accessible in any way to anyone other than authorized users (i.e. if you just serve it over the web, someone will get your account numbers, or worse).
Important Warning¶
This software should be considered alpha quality at best. At this point, I can’t even say that I’m 100% confident it is mathematically correct, balances are right, all scheduled transactions will show up in the right places, etc. I’m going to be testing it for my own purposes, and comparing it against my manual calculations. Until further notice, if you decide to use this, please double-check everything produced by it before relying on its output.
Main Features¶
- Budgeting on a biweekly (fortnightly; every other week) basis, for those of us who are paid that way.
- Optional automatic downloading of transactions/statements from your financial institutions.
Requirements¶
Note: Alternatively, biweeklybudget is also distributed as a Docker container. Using the dockerized version will eliminate all of these dependencies aside from MySQL (which you can run in another container) and Vault (if you choose to take advantage of the OFX downloading), which you can also run in another container.
- Python 2.7 or 3.3+ (currently tested with 2.7, 3.3, 3.4, 3.5, 3.6 and developed with 3.6)
- Python VirtualEnv and
pip
(recommended installation method; your OS/distribution should have packages for these) - Git, to install certain upstream dependencies.
- MySQL, or a compatible database (e.g. MariaDB). biweeklybudget uses SQLAlchemy for database abstraction, but currently specifies some MySQL-specific options, and is only tested with MySQL.
- To use the automated OFX transaction downloading functionality:
- A running, reachable instance of Hashicorp Vault with your financial institution web credentials stored in it.
- PhantomJS for downloading transaction data from institutions that do not support OFX remote access (“Direct Connect”).
Installation¶
It’s recommended that you install into a virtual environment (virtualenv / venv). See the virtualenv usage documentation for information on how to create a venv.
This app is developed against Python 3.6, but should work back to 2.7. It does not support Python3 < 3.3.
Please note that, at the moment, two dependencies are installed via git in order to make use of un-merged pull requests that fix bugs; since
git clone https://github.com/jantman/biweeklybudget.git && cd biweeklybudget
virtualenv --python=python3.6 .
source bin/activate
pip install -r requirements.txt
python setup.py develop
License¶
biweeklybudget itself is licensed under the
GNU Affero General Public License, version 3.
This is specifically intended to extend to anyone who uses the software remotely
over a network, the same rights as those who download and install it locally.
biweeklybudget makes use of various third party software, especially in the UI and
frontend, that is distributed under other licenses. Please see
biweeklybudget/flaskapp/static
in the source tree for further information.
Contents¶
Screenshots¶
Pay Periods View¶
Summary of previous, current and upcoming pay periods, plus date selector to find a pay period.

Single Pay Period View¶
Shows a pay period (current in this example) balances (income, allocated, spent, remaining), budgets and transactions (previous/manually-entered and scheduled).

Accounts View¶

Specific Date Scheduled Transaction¶
Scheduled transactions can occur one-time on a single specific date.

Number Per-Period Scheduled Transactions¶
Scheduled transactions can occur a given number of times per pay period.

Reconcile Transactions with OFX¶
OFX Transactions reported by financial institutions can be marked as reconciled with a corresponding Transaction.

Getting Started¶
Requirements¶
Note: Alternatively, biweeklybudget is also distributed as a Docker container. Using the dockerized version will eliminate all of these dependencies aside from MySQL and Vault (the latter only if you choose to take advantage of the OFX downloading), both of which you can also run in containers.
- Python 2.7 or 3.3+ (currently tested with 2.7, 3.3, 3.4, 3.5, 3.6 and developed with 3.6)
- Python VirtualEnv and
pip
(recommended installation method; your OS/distribution should have packages for these) - Git, to install certain upstream dependencies.
- MySQL, or a compatible database (e.g. MariaDB). biweeklybudget uses SQLAlchemy for database abstraction, but currently specifies some MySQL-specific options, and is only tested with MySQL.
- To use the automated OFX transaction downloading functionality:
- A running, reachable instance of Hashicorp Vault with your financial institution web credentials stored in it.
- PhantomJS for downloading transaction data from institutions that do not support OFX remote access (“Direct Connect”).
Installation¶
It’s recommended that you install into a virtual environment (virtualenv / venv). See the virtualenv usage documentation for information on how to create a venv.
This app is developed against Python 3.6, but should work back to 2.7. It does not support Python3 < 3.3.
Please note that, at the moment, one dependency is installed via git in order
to make use of an un-merged pull request that fixes a bug; since installation doesn’t
support specifying git dependencies in setup.py
, you must install with
requirements.txt
directly:
git clone https://github.com/jantman/biweeklybudget.git && cd biweeklybudget
virtualenv --python=python3.6 .
source bin/activate
pip install -r requirements.txt
python setup.py develop
Configuration¶
biweeklybudget can take its configuration settings via either constants defined in a Python module or environment variables. Configuration in environment variables always overrides configuration from the settings module.
Settings Module¶
biweeklybudget.settings
imports all globals/constants from a
module defined in the SETTINGS_MODULE
environment variable. The recommended
way to configure this is to create your own separate Python package for customization
(either in a private git repository, or just in a directory on your computer)
and install this package into the same virtualenv as biweeklybudget. You then
set the SETTINGS_MODULE
environment variable to the Python module/import
path of this module (i.e. the dotted path, like packagename.modulename
).
Once you’ve created the customization package, you can install it in the virtualenv
with pip install -e <git URL>
(if it is kept in a git repository) or
pip install -e <local path>
.
This customization package can also be used for Loading Data during development, or implementing Custom OFX Downloading via Selenium. It is the recommended configuration method if you need to include more logic than simply defining static configuration settings.
Environment Variables¶
Every configuration setting can also be specified by setting an environment
variable with the same name; these will override any settings defined in
a SETTINGS_MODULE
, if specified. Note that some environment variables
require specific formatting of their values; see the
settings module documentation
for a list
of these variables and the required formats.
Usage¶
Setup¶
source bin/activate
export SETTINGS_MODULE=<settings module>
It’s recommended that you create an alias to do this for you. Alternatively,
instead of setting SETTINGS_MODULE
, you can export the required environment
variables (see above).
Flask¶
For information on the Flask application, see Flask App <flask_app>.
Command Line Entrypoints and Scripts¶
biweeklybudget provides the following setuptools entrypoints (command-line
script wrappers in bin/
). First setup your environment according to the
instructions above.
bin/db_tester.py
- Skeleton of a script that connects to and inits the DB. Edit this to use for one-off DB work.loaddata
- Entrypoint for dropping all existing data and loading test fixture data, or your base data. This is an awful, manual hack right now.ofxbackfiller
- Entrypoint to backfill OFX Statements to DB from disk.ofxgetter
- Entrypoint to download OFX Statements for one or all accounts, save to disk, and load to DB.
Docker¶
Biweeklybudget is also distributed as a docker image, to make it easier to run without installing as many Requirements.
You can pull the latest version of the image with docker pull jantman/biweeklybudget:latest
, or
a specific release version X.Y.Z
with docker pull jantman/biweeklybudget:X.Y.Z
.
The only dependencies for a Docker installation are:
- MySQL, which can be run via Docker (MariaDB recommended) or local on the host
- Vault, if you wish to use the OFX downloading feature, which can also be run via Docker
Important Note: If you run MySQL and/or Vault in containers, please make sure that their data is backed up and will not be removed.
The image runs with the tini init wrapper and uses gunicorn under Python 3.6 to serve the web UI, exposed on port 80. Note that, while it runs with 4 worker threads, there is no HTTP proxy in front of Gunicorn and this image is intended for local network use by a single user/client.
For ease of running, the image defaults the SETTINGS_MODULE
environment variable to
biweeklybudget.settings_example
. This allows leveraging the environment variable
configuration overrides so that you need only
specify configuration options that you want to override from
settings_example.py.
For ease of running, it’s highly recommended that you put your configuration in a Docker-readable environment variables file.
Environment Variable File¶
In the following examples, we reference the following environment variable file.
It will override settings from settings_example.py
as needed; specifically, we need to override the database connection string,
pay period start date and reconcile begin date. In the examples below, we would
save this as biweeklybudget.env
:
DB_CONNSTRING=mysql+pymysql://USERNAME:PASSWORD@HOST:PORT/DBNAME?charset=utf8mb4
PAY_PERIOD_START_DATE=2017-03-28
RECONCILE_BEGIN_DATE=2017-02-15
Containerized MySQL Example¶
This assumes that you already have a MySQL database container running with the container name “mysql” and exposing port 3306, and that we want the biweeklybudget web UI served on host port 8080:
In our biweeklybudget.env
, we would specify the database connection string for the “mysql” container:
DB_CONNSTRING=mysql+pymysql://USERNAME:PASSWORD@mysql:3306/DBNAME?charset=utf8mb4
And then run biweeklybudget:
docker run --name biweeklybudget --env-file biweeklybudget.env \
-p 8080:80 --link mysql jantman/biweeklybudget:latest
Host-Local MySQL Example¶
It is also possible to use a MySQL server on the physical (Docker) host system. To do so,
you’ll need to know the host system’s IP address. On Linux when using the default “bridge”
Docker networking mode, this will coorespond to a docker0
interface on the host system.
The Docker documentation on adding entries to the Container’s hosts file
provides a helpful snippet for this (on my systems, this results in 172.17.0.1
):
ip -4 addr show scope global dev docker0 | grep inet | awk '{print $2}' | cut -d / -f 1
In our biweeklybudget.env
, we would specify the database connection string that uses the “dockerhost” hosts file entry, created by the --add-host
option:
# "dockerhost" is added to /etc/hosts via the `--add-host` docker run option
DB_CONNSTRING=mysql+pymysql://USERNAME:PASSWORD@dockerhost:3306/DBNAME?charset=utf8mb4
So using that, we could run biweeklybudget listening on port 8080 and using our host’s MySQL server (on port 3306):
docker run --name biweeklybudget --env-file biweeklybudget.env \
--add-host="dockerhost:$(ip -4 addr show scope global dev docker0 | grep inet | awk '{print $2}' | cut -d / -f 1)" \
-p 8080:80 jantman/biweeklybudget:latest
You may need to adjust those commands depending on your operating system, Docker networking mode, and MySQL server.
Settings Module Example¶
If you need to provide biweeklybudget with more complicated configuration, this is
still possible via a Python settings module. The easiest way to inject one into the
Docker image is to mount
a python module directly into the biweeklybudget package directory. Assuming you have
a custom settings module on your local machine at /opt/biweeklybudget-settings.py
, you would
run the container as shown below to mount the custom settings module into the container and use it.
Note that this example assumes using MySQL in another container; adjust as necessary if you are using
MySQL running on the Docker host:
docker run --name biweeklybudget -e SETTINGS_MODULE=biweeklybudget.mysettings \
-v /opt/biweeklybudget-settings.py:/app/lib/python3.6/site-packages/biweeklybudget/mysettings.py \
-p 8080:80 --link mysql jantman/biweeklybudget:latest
Note on Locales¶
biweeklybudget uses Python’s locale module
to format currency. This requires an appropriate locale installed on the system. The docker image
distributed for this package only includes the en_US.UTF-8
locale. If you need a different one,
please cut a pull request against docker_build.py
.
Flask Application¶
Running¶
- First, setup your environment per Getting Started - Setup.
export FLASK_APP="biweeklybudget.flaskapp.app"
flask --help
for information on usage:
- Run App:
flask run
- Run with debug/reload:
flask rundev
To run the app against the acceptance test database, use: DB_CONNSTRING='mysql+pymysql://budgetTester@127.0.0.1:3306/budgettest?charset=utf8mb4' flask run
By default, Flask will only bind to localhost. If you want to bind to all interfaces, you can add --host=0.0.0.0
to the flask run
commands. Please be aware of the implications of this (see “Security”, below).
If you wish to run the flask app in a multi-process/thread/worker WSGI container,
be sure that you run the initdb
entrypoint before starting the workers. Otherwise,
it’s likely that all workers will attempt to create the database tables or run migrations
at the same time, and fail.
Security¶
This code hasn’t been audited. It might have SQL injection vulnerabilities in it. It might dump your bank account details in HTML comments. Anything is possible!
To put it succinctly, this was written to be used by me, and me only. It was written with the assumption that anyone who can possibly access any of the application at all, whether in a browser or locally, is authorized to view and/or edit anything and everything related to the application (configuration, everything in the database, everything in Vault if it’s being used). If you even think about making this accessible to anything other than localhost on a computer you physically own, it’s entirely up to you how you secure it, but make sure you do it really well.
OFX Transaction Downloading¶
biweeklybudget has the ability to download OFX transaction data from your
financial institutions, either manually or automatically (via an external
command scheduler such as cron
).
There are two overall methods of downloading transaction data; for banks that
support the OFX protocol, statement data can be downloaded
using HTTP only, via the ofxclient project (note our requirements file
specifies the upstream of PR #37,
which includes a fix for Discover credit cards). For banks that do not support the
OFX protocol and require you to use their website to download OFX format statements,
biweeklybudget provides a base ScreenScraper
class that can be used to develop a selenium-based
tool to automate logging in to your bank’s site and downloading the OFX file.
In order to use either of these methods, you must have an instance of Hashicorp Vault running and have your login credentials stored in it.
Important Note on Transaction Downloading¶
biweeklybudget includes support for automatically downloading transaction data from your bank. Credentials are stored in an instance of Hashicorp Vault, as that is a project the author has familiarity with, and was chosen as the most secure way of storing and retrieving secrets non-interactively. Please keep in mind that it is your decision and your decision alone how secure your banking credentials are kept. What is considered acceptable to the author of this program may not be acceptably secure for others; it is your sole responsibility to understand the security and privacy implications of this program as well as Vault, and to understand the risks of storing your banking credentials in this way.
Also note that biweeklybudget includes a base class (ScreenScraper
)
intended to simplify developing selenium-based
browser automation to log in to financial institution websites and download your transactions.
Many banks and other financial institutions have terms of service that
explicitly forbid automated or programmatic use of their websites. As such, it is up to you
as the user of this software to determine your bank’s policy and abide by it. I provide a
base class to help in writing automated download tooling if your institution allows it, but
I cannot and will not distribute institution-specific download tooling.
ofxgetter entrypoint¶
This package provides an ofxgetter
command line entrypoint that can be used to
download OFX statements for one or all Accounts that are appropriately configured. The
script used for this provides exit codes and logging suitable for use via cron
(
it exits non-zero if any accounts failed, and unless options are provided to increase
verbosity, only outputs the number of accounts successfully downloaded as well as any
errors).
Vault Setup¶
Configuring and running Vault is outside the scope of this document. Once you have
a Vault installation running and appropriately secured (you shouldn’t be using the
dev server unless you want to lose all your data every time you reboot) and have given
biweeklybudget access to a valid token stored in a file somewhere, you’ll need to ensure
that your username and password data is stored in Vault in the proper format (username
and password
keys). If you happen to use LastPass
to store your passwords, you may find my lastpass2vault.py
helpful; run it as ./lastpass2vault.py -vv -f PATH_TO_VAULT_TOKEN LASTPASS_USERNAME
and
it will copy all of your credentials from LastPass to Vault, preserving the folder structure.
Configuring Accounts for Downloading with ofxclient¶
- Use the
ofxclient
CLI to configure and test your account. - Put your creds in Vault.
- Migrate ~/ofxclient.ini to JSON, add it to your
Account
.
A working configuration for a Bank account might look something like this:
{
"routing_number": "012345678",
"account_type": "CHECKING",
"description": "Checking",
"number": "111222333",
"local_id": "f0a14074d33cdf83b4a099bc322dbe2fe19680ca1719425b33de5022",
"institution": {
"client_args": {
"app_version": "2200",
"app_id": "QWIN",
"ofx_version": "103",
"id": "f87217350cc341e2ba7407cf99dcdede"
},
"description": "MyBank",
"url": "https://ofx.MyBank.com",
"local_id": "e51fb78f88580a1c2e3bb65bd59495384388abda8796c9bf06dcf",
"broker_id": "",
"org": "ORG",
"id": "98765"
}
}
Configuring Accounts for Downloading with Selenium¶
In your customization package <_getting_started.customization>, subclass
ScreenScraper
. Override the constructor
to take whatever keyword arguments are required, and add those to your account’s
ofxgetter_config_json
as shown below. :py:class:~biweeklybudget.ofxgetter.OfxGetter`
will instantiate the class passing it the specified keyword arguments in addition to
username
, password
and savedir
keyword arguments. savedir
is the
directory under STATEMENTS_SAVE_PATH
where the account’s
OFX statements should be saved. After instantiating the class, ofxgetter
will
call the class’s run()
method with no arguments, and expect to receive an OFX
statement string back.
If cookies are a concern, be aware that saving and loading cookies is
broken in PhantomJS 2.x.
If you need to persist cookies across sessions, look into the
ScreenScraper
class’
load_cookies()
and
save_cookies()
methods.
{
"class_name": "MyScraper",
"module_name": "budget_customization.myscraper",
"institution": {},
"kwargs": {
"acct_num": "1234"
}
}
Here’s a simple, contrived example of such a class:
import logging
import time
import codecs
from datetime import datetime
from selenium.common.exceptions import NoSuchElementException
from biweeklybudget.screenscraper import ScreenScraper
logger = logging.getLogger(__name__)
# suppress selenium logging
selenium_log = logging.getLogger("selenium")
selenium_log.setLevel(logging.WARNING)
selenium_log.propagate = True
class MyScraper(ScreenScraper):
def __init__(self, username, password, savedir='./',
acct_num=None, screenshot=False):
"""
:param username: username
:type username: str
:param password: password
:type password: str
:param savedir: directory to save OFX in
:type savedir: str
:param acct_num: last 4 of account number, as shown on homepage
:type acct_num: str
"""
super(MyScraper, self).__init__(
savedir=savedir, screenshot=screenshot
)
self.browser = self.get_browser('phantomjs')
self.username = username
self.password = password
self.acct_num = acct_num
def run(self):
""" download the transactions, return file path on disk """
logger.debug("running, username={u}".format(u=self.username))
logger.info('Logging in...')
try:
self.do_login(self.username, self.password)
logger.info('Logged in; sleeping 2s to stabilize')
time.sleep(2)
self.do_screenshot()
self.select_account()
act = self.get_account_activity()
except Exception:
self.error_screenshot()
raise
return act
def do_login(self, username, password):
self.get_page('http://example.com')
raise NotImplementedError("login to your bank here")
def select_account(self):
self.get_page('http://example.com')
logger.debug('Finding account link...')
link = self.browser.find_element_by_xpath(
'//a[contains(text(), "%s")]' % self.acct_num
)
logger.debug('Clicking account link: %s', link)
link.click()
self.wait_for_ajax_load()
self.do_screenshot()
def get_account_activity(self):
# some bank-specific stuff here, then we POST to get OFX
post_list = self.xhr_post_urlencoded(
post_url, post_data, headers=post_headers
)
if not post_list.startswith('OFXHEADER'):
self.error_screenshot()
with codecs.open('result', 'w', 'utf-8') as fh:
fh.write(post_list)
raise SystemExit("Got non-OFX response")
return post_list
Getting Help¶
Bugs and Feature Requests¶
Bug reports and feature requests are happily accepted via the GitHub Issue Tracker. Pull requests are welcome. Issues that don’t have an accompanying pull request will be worked on as my time and priority allows.
Development¶
To install for development:
- Fork the biweeklybudget repository on GitHub
- Create a new branch off of master in your fork.
$ virtualenv biweeklybudget
$ cd biweeklybudget && source bin/activate
$ pip install -e git+git@github.com:YOURNAME/biweeklybudget.git@BRANCHNAME#egg=biweeklybudget
$ cd src/biweeklybudget
The git clone you’re now in will probably be checked out to a specific commit,
so you may want to git checkout BRANCHNAME
.
Guidelines¶
- pep8 compliant with some exceptions (see pytest.ini)
- 100% test coverage with pytest (with valid tests)
Loading Data¶
The sample data used for acceptance tests is defined in biweeklybudget/tests/fixtures/sampledata.py
.
This data can be loaded by setting up the environment <_getting_started.setup>
and then using the loaddata
entrypoint (the following values for
options are actually the defaults, but are shown for clarity):
loaddata -m biweeklybudget.tests.fixtures.sampledata -c SampleDataLoader
This entrypoint will drop all tables and data and then load fresh data from the specified class.
If you wish, you can copy biweeklybudget/tests/fixtures/sampledata.py
to your
customization package <_getting_started.customization> and edit it to load your own
custom data. This should only be required if you plan on dropping and reinitializing the
database often.
Testing¶
Testing is done via pytest, driven by tox.
- testing is as simple as:
pip install tox
tox
- If you want to pass additional arguments to pytest, add them to the tox command line after “–”. i.e., for verbose pytext output on py27 tests:
tox -e py27 -- -v
For rapid iteration on tests, you can either use my
toxit script
to re-run the test commands in an existing tox environment, or you can use
the bin/t
and bin/ta
scripts to run unit or acceptance tests,
respectively, on only one module.
Unit Tests¶
There are minimal unit tests, really only some examples and room to test some potentially fragile code. Run them via the ^py\d+
tox environments.
Integration Tests¶
There’s a pytest marker for integration tests, effectively defined as anything that might use either a mocked/in-memory DB or the flask test client, but no HTTP server and no real RDBMS. Run them via the integration
tox environment. But there aren’t any of them yet.
Acceptance Tests¶
There are acceptance tests, which use a real MySQL DB (see the connection string in tox.ini
and conftest.py
) and a real Flask HTTP server, and selenium. Run them via the acceptance
tox environment.
The acceptance tests connect to a local MySQL database using a connection string specified by the DB_CONNSTRING
environment variable, or defaulting to a DB name and user/password that can be seen in conftest.py
. Once connected, the tests will drop all tables in the test DB, re-create all models/tables, and then load sample data. After the DB is initialized, tests will run the local Flask app on a random port, and run Selenium backed by PhantomJS.
If you want to run the acceptance tests without dumping and refreshing the test database, export the NO_REFRESH_DB
environment variable. Setting the NO_CLASS_REFRESH_DB
environment variable will prevent refreshing the DB after classes that manipulate data;
this will cause subsequent tests to fail but can be useful for debugging.
Alembic DB Migrations¶
This project uses Alembic for DB migrations:
- To generate migrations, run
alembic -c biweeklybudget/alembic/alembic.ini revision --autogenerate -m "message"
and examine/edit then commit the resulting file(s). - To apply migrations, run
alembic -c biweeklybudget/alembic/alembic.ini upgrade head
. - To see the current DB version, run
alembic -c biweeklybudget/alembic/alembic.ini current
. - To see migration history, run
alembic -c biweeklybudget/alembic/alembic.ini history
.
Database Debugging¶
If you set the SQL_ECHO
environment variable to “true”, all SQL run by
SQLAlchemy will be logged at INFO level.
Docker Image Build¶
Use the docker
tox environment. See the docstring at the top of
biweeklybudget/tests/docker_build.py
for further information.
Frontend / UI¶
The UI is based on BlackrockDigital’s startbootstrap-sb-admin-2,
currently as of the 3.3.7-1 GitHub release. It is currently not modified at all, but should it need to be rebuilt,
this can be done with: pushd biweeklybudget/flaskapp/static/startbootstrap-sb-admin-2 && gulp
Sphinx also generates documentation for the custom javascript files. This must be done manually
on a machine with jsdoc installed, via: tox -e jsdoc
.
Release Checklist¶
- Open an issue for the release; cut a branch off master for that issue.
- Verify whether or not DB migrations are needed. If they are, ensure they’ve been created, tested and verified.
- Confirm that there are CHANGES.rst entries for all major changes.
- Rebuild documentation and javascript documentation locally:
tox -e jsdoc,docs
. Commit any changes. - Run the Docker image build and tests locally:
tox -e docker
. - Ensure that Travis tests passing in all environments.
- Ensure that test coverage is no less than the last release, and that there are acceptance tests for any non-trivial changes.
- If there have been any major visual or functional changes to the UI, regenerate screenshots via
tox -e screenshots
. - Increment the version number in biweeklybudget/version.py and add version and release date to CHANGES.rst, then push to GitHub.
- Confirm that README.rst renders correctly on GitHub.
- Upload package to testpypi:
- Make sure your ~/.pypirc file is correct (a repo called
test
for https://testpypi.python.org/pypi)rm -Rf dist
python setup.py register -r https://testpypi.python.org/pypi
python setup.py sdist bdist_wheel
twine upload -r test dist/*
- Check that the README renders at https://testpypi.python.org/pypi/biweeklybudget
- Create a pull request for the release to be merged into master. Upon successful Travis build, merge it.
- Tag the release in Git, push tag to GitHub:
- tag the release. for now the message is quite simple:
git tag -a X.Y.Z -m 'X.Y.Z released YYYY-MM-DD'
- push the tag to GitHub:
git push origin X.Y.Z
- Upload package to live pypi:
twine upload dist/*
- Build and push the new Docker image:
- Check out the git tag:
git checkout X.Y.Z
- Build the Docker image:
tox -e docker
- Follow the instructions from that script to push the image to the Docker Hub and tag a “latest” version.
- make sure any GH issues fixed in the release were closed.
biweeklybudget¶
biweeklybudget package¶
Subpackages¶
biweeklybudget.flaskapp package¶
Subpackages¶
Submodules¶
-
biweeklybudget.flaskapp.cli_commands.
template_paths
()[source]¶ Return a list of all Flask app template paths, to auto-reload on change.
from http://stackoverflow.com/a/41666467/211734
Returns: list of all template paths Return type: list
-
class
biweeklybudget.flaskapp.jsonencoder.
MagicJSONEncoder
(skipkeys=False, ensure_ascii=True, check_circular=True, allow_nan=True, sort_keys=False, indent=None, separators=None, encoding='utf-8', default=None)[source]¶ Bases:
json.encoder.JSONEncoder
Customized JSONEncoder class that uses
as_dict
properties on objects to encode them.
-
class
biweeklybudget.flaskapp.notifications.
NotificationsController
[source]¶ Bases:
object
-
static
budget_account_sum
()[source]¶ Return the sum of current balances for all is_budget_source accounts.
Returns: Combined balance of all budget source accounts Return type: float
-
static
get_notifications
()[source]¶ Return all notifications that should be displayed at the top of pages, as a list in the order they should appear. Each list item is a dict with keys “classes” and “content”, where classes is the string that should appear in the notification div’s “class” attribute, and content is the string content of the div.
-
static
num_stale_accounts
()[source]¶ Return the number of accounts with stale data.
@TODO This is a hack because I just cannot figure out how to do this natively in SQLAlchemy.
Returns: count of accounts with stale data Return type: int
-
static
biweeklybudget.models package¶
Submodules¶
-
class
biweeklybudget.models.account.
Account
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.account.Account'> at 7fa6eedeb990>¶
-
all_statements
¶ Relationship to all
OFXStatement
for this Account
-
balance
¶ Return the latest AccountBalance object for this Account.
Returns: latest AccountBalance for this Account Return type: biweeklybudget.models.account_balance.AccountBalance
-
credit_limit
¶ credit limit, for credit accounts
-
description
¶ description
-
for_ofxgetter
¶ Return whether or not this account should be handled by ofxgetter.
Returns: whether or not ofxgetter should run for this account Return type: bool
-
id
¶ Primary Key
-
is_active
¶ whether or not the account is active and can be used, or historical
-
is_budget_source
¶ Return whether or not this account should be considered a funding source for Budgets.
Returns: whether or not this account is a Budget funding source Return type: bool
-
is_stale
¶ Return whether or not there is stale data for this account.
Returns: whether or not data for this account is stale Return type: bool
-
name
¶ name for the account
-
negate_ofx_amounts
¶ For use in reconciling our
Transaction
entries with the account’sOFXTransaction
entries, whether or not to negate the OfxTransaction amount. We enter Transactions with income as negative amounts and expenses as positive amounts, but most bank OFX statements will show the opposite.
-
ofx_cat_memo_to_name
¶ whether or not to concatenate the OFX memo text onto the OFX name text; for banks like Chase that use the memo for run-on from the name
-
ofx_statement
¶ Return the latest OFXStatement for this Account.
Returns: latest OFXStatement for this Account Return type: biweeklybudget.models.ofx_statement.OFXStatement
-
ofxgetter_config
¶ Return the deserialized ofxgetter_config_json dict.
Returns: ofxgetter config Return type: dict
-
ofxgetter_config_json
¶ JSON-encoded ofxgetter configuration
-
re_fee
¶ regex for matching transactions as fees
-
re_interest_charge
¶ regex for matching transactions as interest charges
-
re_interest_paid
¶ regex for matching transactions as interest paid
-
re_payment
¶ regex for matching transactions as payments
-
reconcile_trans
¶ Include Transactions and OFXTransactions from this account when reconciling. Set to False to exclude accounts that are investment, payment only, or otherwise won’t have a matching Transaction for each OFXTransaction.
-
set_balance
(**kwargs)[source]¶ Create an AccountBalance object for this account and associate it with the account. Add it to the current session.
-
set_ofxgetter_config
(config)[source]¶ Set ofxgetter configuration.
Parameters: config (dict) – ofxgetter configuration
-
unreconciled
¶ Return a query to match all unreconciled Transactions for this account.
Parameters: db (sqlalchemy.orm.session.Session) – active database session to use for queries Returns: query to match all unreconciled Transactions Return type: sqlalchemy.orm.query.Query
-
unreconciled_sum
¶ Return the sum of all unreconciled transaction amounts for this account.
Returns: sum of amounts of all unreconciled transactions Return type: float
-
vault_creds_path
¶ path in Vault to read the credentials from
-
-
class
biweeklybudget.models.account.
AcctType
[source]¶ Bases:
enum.Enum
-
Bank
= 1¶
-
Cash
= 4¶
-
Credit
= 2¶
-
Investment
= 3¶
-
Other
= 5¶
-
_member_map_
= OrderedDict([('Bank', <AcctType.Bank: 1>), ('Credit', <AcctType.Credit: 2>), ('Investment', <AcctType.Investment: 3>), ('Cash', <AcctType.Cash: 4>), ('Other', <AcctType.Other: 5>)])¶
-
_member_names_
= ['Bank', 'Credit', 'Investment', 'Cash', 'Other']¶
-
_value2member_map_
= {1: <AcctType.Bank: 1>, 2: <AcctType.Credit: 2>, 3: <AcctType.Investment: 3>, 4: <AcctType.Cash: 4>, 5: <AcctType.Other: 5>}¶
-
as_dict
¶
-
-
class
biweeklybudget.models.account_balance.
AccountBalance
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.account_balance.AccountBalance'> at 7fa6ef3d5ab8>¶
-
account_id
¶ ID of the account this balance is for
-
avail
¶ Available balance
-
avail_date
¶ as-of date for the available balance
-
id
¶ Primary Key
-
ledger
¶ Ledger balance, or investment account value, or credit card balance
-
ledger_date
¶ as-of date for the ledger balance
-
overall_date
¶ overall balance as of DateTime
-
-
class
biweeklybudget.models.budget_model.
Budget
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.budget_model.Budget'> at 7fa6eedebd08>¶
-
current_balance
¶ current balance for standing budgets
-
description
¶ description
-
id
¶ Primary Key
-
is_active
¶ whether active or historical
-
is_income
¶ whether this is an Income budget (True) or expense (False).
-
is_periodic
¶ Whether the budget is standing (long-running) or periodic (resets each pay period or budget cycle)
-
name
¶ name of the budget
-
starting_balance
¶ starting balance for periodic budgets
-
-
class
biweeklybudget.models.ofx_statement.
OFXStatement
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.ofx_statement.OFXStatement'> at 7fa6eedb62a0>¶
-
account_id
¶ Foreign key - Account.id - ID of the account this statement is for
-
acct_type
¶ Textual account type, from the bank (i.e. “Checking”)
-
acctid
¶ Institution’s account ID
-
as_of
¶ Last OFX statement datetime
-
avail_bal
¶ Available balance
-
avail_bal_as_of
¶ as-of date for the available balance
-
bankid
¶ FID of the Institution
-
brokerid
¶ BrokerID, for investment accounts
-
currency
¶ Currency definition (“USD”)
-
file_mtime
¶ File mtime
-
filename
¶ Filename parsed from
-
id
¶ Unique ID
-
ledger_bal
¶ Ledger balance, or investment account value
-
ledger_bal_as_of
¶ as-of date for the ledger balance
-
routing_number
¶ Routing Number
-
type
¶ Account Type, string corresponding to ofxparser.ofxparser.AccountType
-
-
class
biweeklybudget.models.ofx_transaction.
OFXTransaction
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.ofx_transaction.OFXTransaction'> at 7fa6eedb6990>¶
-
account
¶ Account this transaction is associated with
-
account_amount
¶ Return the amount of the transaction, appropriately negated if the
Account
for this transaction hasnegate_ofx_amounts
True.Returns: amount, negated as appropriate Return type: decimal.Decimal
-
account_id
¶ Account ID this transaction is associated with
-
amount
¶ OFX - Amount
-
checknum
¶ OFX - Checknum
-
date_posted
¶ OFX - Date Posted
-
description
¶ Description
-
fitid
¶ OFX - FITID
-
is_interest_charge
¶ Account’s
re_interest_charge
matched
-
is_interest_payment
¶ Account’s
re_interest_paid
matched
-
is_late_fee
¶ Account’s
re_late_fee
matched
-
is_other_fee
¶ Account’s
re_fee
matched
-
is_payment
¶ Account’s
re_payment
matched
-
mcc
¶ OFX - MCC
-
memo
¶ OFX - Memo
-
name
¶ OFX - Name
-
notes
¶ Notes
-
static
params_from_ofxparser_transaction
(t, acct_id, stmt, cat_memo=False)[source]¶ Given an ofxparser.ofxparser.Transaction object, generate and return a dict of kwargs to create a new OFXTransaction.
Parameters: - t (
ofxparser.ofxparser.Transaction
) – ofxparser transaction - acct_id (int) – OFXAccount ID
- stmt (biweeklybudget.models.ofx_statement.OFXStatement) – OFXStatement this transaction was on
- cat_memo (bool) – whether or not to concatenate OFX Memo to Name
Returns: dict of kwargs to create an OFXTransaction
Return type: - t (
-
reconcile_id
¶ The reconcile_id for the OFX Transaction
-
sic
¶ OFX - SIC
-
statement
¶ OFXStatement this transaction was last seen in
-
statement_id
¶ OFXStatement ID this transaction was last seen in
-
trans_type
¶ OFX - Transaction Type
-
static
unreconciled
(db)[source]¶ Return a query to match all unreconciled OFXTransactions.
Parameters: db (sqlalchemy.orm.session.Session) – active database session to use for queries Returns: query to match all unreconciled OFXTransactions Return type: sqlalchemy.orm.query.Query
-
-
class
biweeklybudget.models.reconcile_rule.
ReconcileRule
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.reconcile_rule.ReconcileRule'> at 7fa6eedb6be0>¶
-
id
¶ Primary Key
-
is_active
¶ whether the rule is enabled or disabled
-
name
¶ Name of the rule
-
-
class
biweeklybudget.models.scheduled_transaction.
ScheduledTransaction
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.scheduled_transaction.ScheduledTransaction'> at 7fa6eed7c2a0>¶
-
account_id
¶ ID of the account the transaction is against
-
amount
¶ Amount of the transaction
-
budget_id
¶ ID of the budget the transaction is against
-
date
¶ Denotes a scheduled transaction that will happen once on the given date
-
day_of_month
¶ Denotes a scheduled transaction that happens on the same day of each month
-
description
¶ description
-
id
¶ Primary Key
-
is_active
¶ whether the scheduled transaction is enabled or disabled
-
notes
¶ notes
-
num_per_period
¶ Denotes a scheduled transaction that happens N times per pay period
-
recurrence_str
¶ Return a string describing the recurrence interval. This is a string of the format
YYYY-mm-dd
,N per period
orN(st|nd|rd|th)
whereN
is an integer.Returns: string describing recurrence interval Return type: str
-
-
class
biweeklybudget.models.transaction.
Transaction
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.transaction.Transaction'> at 7fa6eedeb2a0>¶
-
account_id
¶ ID of the account this transaction is against
-
actual_amount
¶ Actual amount of the transaction
-
budget_id
¶ ID of the Budget this transaction is against
-
budgeted_amount
¶ Budgeted amount of the transaction
-
date
¶ date of the transaction
-
description
¶ description
-
id
¶ Primary Key
-
notes
¶ free-form notes
-
scheduled_trans
¶ Relationship - the
ScheduledTransaction
this Transaction was created from; set when a scheduled transaction is converted to a real one
-
scheduled_trans_id
¶ ID of the ScheduledTransaction this Transaction was created from; set when a scheduled transaction is converted to a real one
-
static
unreconciled
(db)[source]¶ Return a query to match all unreconciled Transactions.
Parameters: db (sqlalchemy.orm.session.Session) – active database session to use for queries Returns: query to match all unreconciled Transactions Return type: sqlalchemy.orm.query.Query
-
-
class
biweeklybudget.models.txn_reconcile.
TxnReconcile
(**kwargs)[source]¶ Bases:
sqlalchemy.ext.declarative.api.Base
,biweeklybudget.models.base.ModelAsDict
-
_sa_class_manager
= <ClassManager of <class 'biweeklybudget.models.txn_reconcile.TxnReconcile'> at 7fa6eed7cab8>¶
-
id
¶ Primary Key
-
note
¶ Notes
-
ofx_account_id
¶ OFX Transaction Account ID
-
ofx_fitid
¶ OFX Transaction FITID
-
ofx_trans
¶ Relationship -
OFXTransaction
-
reconciled_at
¶ time when this reconcile was made
-
rule
¶ Relationship -
ReconcileRule
that created this reconcile, if any.
-
rule_id
¶ ReconcileRule ID; set if this reconcile was created by a rule
-
transaction
¶ Relationship -
Transaction
-
txn_id
¶ Transaction ID
-
Submodules¶
biweeklybudget.backfill_ofx module¶
-
class
biweeklybudget.backfill_ofx.
OfxBackfiller
(savedir)[source]¶ Bases:
object
Class to backfill OFX in database from files on disk.
-
_do_account_dir
(acct_id, acct_name, cat_memo, path)[source]¶ Handle all OFX statements in a per-account directory.
Parameters:
-
_do_one_file
(updater, path)[source]¶ Parse one OFX file and use OFXUpdater to upsert it into the DB.
Parameters: - updater (biweeklybudget.ofxupdater.OFXUpdater) – OFXUpdater instance for this class
- path (str) – absolute path to OFX/QFX file
-
-
biweeklybudget.backfill_ofx.
main
()[source]¶ Main entry point - instantiate and run
OfxBackfiller
.
biweeklybudget.biweeklypayperiod module¶
-
class
biweeklybudget.biweeklypayperiod.
BiweeklyPayPeriod
(start_date, db_session)[source]¶ Bases:
object
This object contains all logic related to working with pay periods, specifically finding a pay period for a given data, and figuring out the start and end dates of pay periods. Sure, the app is called “biweeklybudget” but there’s no reason to hard-code logic all over the place that’s this simple.
-
_data
¶ Return the object-local data cache dict. Built it if not already present.
Returns: object-local data cache Return type: dict
-
_dict_for_sched_trans
(t)[source]¶ Return a dict describing the ScheduledTransaction t. Called from
_trans_dict()
.The resulting dict will have the following layout:
type
(str) “Transaction” or “ScheduledTransaction”id
(int) the id of the objectdate
(date) the date of the transaction, or None for per-period ScheduledTransactionssched_type
(str) for ScheduledTransactions, the schedule type (“monthly”, “date”, or “per period”)sched_trans_id
Nonedescription
(str) the transaction descriptionamount
(float) the transaction amountbudgeted_amount
Noneaccount_id
(int) the id of the Account the transaction is against.account_name
(str) the name of the Account the transaction is against.budget_id
(int) the id of the Budget the transaction is against.budget_name
(str) the name of the Budget the transaction is against.reconcile_id
(int) the ID of the TxnReconcile, or None
Parameters: t (ScheduledTransaction) – ScheduledTransaction to describe Returns: common-format dict describing t
Return type: dict
-
_dict_for_trans
(t)[source]¶ Return a dict describing the Transaction t. Called from
_trans_dict()
.The resulting dict will have the following layout:
type
(str) “Transaction” or “ScheduledTransaction”id
(int) the id of the objectdate
(date) the date of the transaction, or None for per-period ScheduledTransactionssched_type
(str) for ScheduledTransactions, the schedule type (“monthly”, “date”, or “per period”)sched_trans_id
(int) for Transactions, the ScheduledTransactionid
that it was created from, or None.description
(str) the transaction descriptionamount
(float) the transaction amountbudgeted_amount
(float) the budgeted amount. This may be None.account_id
(int) the id of the Account the transaction is against.account_name
(str) the name of the Account the transaction is against.budget_id
(int) the id of the Budget the transaction is against.budget_name
(str) the name of the Budget the transaction is against.reconcile_id
(int) the ID of the TxnReconcile, or None
Parameters: t (Transaction) – transaction to describe Returns: common-format dict describing t
Return type: dict
-
_income_budget_ids
¶ Return a list of all
Budget
IDs for Income budgets.Returns: list of income budget IDs Return type: list
-
_make_budget_sums
()[source]¶ Find the sums of all transactions per periodic budget ID ; return a dict where keys are budget IDs and values are per-budget dicts containing:
budget_amount
(float) - the periodic budgetstarting_balance
.allocated
(float) - sum of allScheduledTransaction
andTransaction
amounts against the budget this period. For actual transactions, we use thebudgeted_amount
if present (not None).spent
(float) - the sum of all actualTransaction
amounts against the budget this period.trans_total
(float) - the sum of spent amounts for Transactions that have them, or allocated amounts for ScheduledTransactions.remaining
(float) - the remaining amount in the budget. This isbudget_amount
minus the greater ofallocated
ortrans_total
. For income budgets, this is always positive.
Returns: dict of dicts, transaction sums and amounts per budget Return type: dict
-
_make_combined_transactions
()[source]¶ Combine all Transactions and ScheduledTransactions from
self._data_cache
into one ordered list of similar dicts, adding dates to the monthly ScheduledTransactions as appropriate and excluding ScheduledTransactions that have been converted to real Transactions. Store the finished list back intoself._data_cache
.
-
_make_overall_sums
()[source]¶ Return a dict describing the overall sums for this pay period, namely:
allocated
(float) total amount allocated viaScheduledTransaction
,Transaction
(counting thebudgeted_amount
for Transactions that have one), orBudget
(not counting income budgets).spent
(float) total amount actually spent viaTransaction
.income
(float) total amount of income allocated this pay period. Calculated value (from_make_budget_sums()
/self._data_cache['budget_sums']
) should be negative, but is returned as its positive inverse (absolute value).remaining
(float) income minus the greater ofallocated
orspent
Returns: dict describing sums for the pay period Return type: dict
-
_scheduled_transactions_date
()[source]¶ Return a Query for all
ScheduledTransaction
defined by date (schedule_type == “date”) for this pay period.Returns: Query matching all ScheduledTransactions defined by date, for this pay period. Return type: sqlalchemy.orm.query.Query
-
_scheduled_transactions_monthly
()[source]¶ Return a Query for all
ScheduledTransaction
defined by day of month (schedule_type == “monthly”) for this pay period.Returns: Query matching all ScheduledTransactions defined by day of month (monthly) for this period. Return type: sqlalchemy.orm.query.Query
-
_scheduled_transactions_per_period
()[source]¶ Return a Query for all
ScheduledTransaction
defined by number per period (schedule_type == “per period”) for this pay period.Returns: Query matching all ScheduledTransactions defined by number per period, for this pay period. Return type: sqlalchemy.orm.query.Query
-
_trans_dict
(t)[source]¶ Given a Transaction or ScheduledTransaction, return a dict of a common format describing the object.
The resulting dict will have the following layout:
type
(str) “Transaction” or “ScheduledTransaction”id
(int) the id of the objectdate
(date) the date of the transaction, or None for per-period ScheduledTransactionssched_type
(str) for ScheduledTransactions, the schedule type (“monthly”, “date”, or “per period”)sched_trans_id
(int) for Transactions, the ScheduledTransactionid
that it was created from, or None.description
(str) the transaction descriptionamount
(float) the transaction amountbudgeted_amount
(float) the budgeted amount. This may be None.account_id
(int) the id of the Account the transaction is against.account_name
(str) the name of the Account the transaction is against.budget_id
(int) the id of the Budget the transaction is against.budget_name
(str) the name of the Budget the transaction is against.reconcile_id
(int) the ID of the TxnReconcile, or None
Parameters: t ( Transaction
orScheduledTransaction
) – the object to return a dict forReturns: dict describing t
Return type: dict
-
_transactions
()[source]¶ Return a Query for all
Transaction
for this pay period.Returns: Query matching all Transactions for this pay period Return type: sqlalchemy.orm.query.Query
-
budget_sums
¶ Return a dict of budget sums; the return value of
_make_budget_sums()
.Returns: dict of dicts, transaction sums and amounts per budget Return type: dict
-
end_date
¶ Return the date of the last day in this pay period. The pay period is generally considered to end at the last instant (i.e. 23:59:59) of this date.
Returns: last date in the pay period Return type: datetime.date
-
filter_query
(query, date_prop)[source]¶ Filter
query
fordate_prop
in this pay period. Returns a copy of the query.e.g. to filter an existing query of
OFXTransaction
for the BiweeklyPayPeriod starting on 2017-01-14:q = # some query here p = BiweeklyPayPeriod(date(2017, 1, 14)) q = p.filter_query(q, OFXTransaction.date_posted)
Parameters: - query (
sqlalchemy.orm.query.Query
) – The query to filter - date_prop – the Model’s date property, to filter on.
Returns: the filtered query
Return type: sqlalchemy.orm.query.Query
- query (
-
next
¶ Return the BiweeklyPayPeriod following this one.
Returns: next BiweeklyPayPeriod after this one Return type: BiweeklyPayPeriod
-
overall_sums
¶ Return a dict of overall sums; the return value of
_make_overall_sums()
.Returns: dict describing sums for the pay period Return type: dict
-
static
period_for_date
(dt, db_session)[source]¶ Given a datetime, return the BiweeklyPayPeriod instance describing the pay period containing this date.
Todo
This is a very naive, poorly-performing implementation.
Parameters: - dt (
datetime
ordate
) – datetime or date to find the pay period for - db_session (sqlalchemy.orm.session.Session) – active database session to use for queries
Returns: BiweeklyPayPeriod containing the specified date
Return type: - dt (
-
period_interval
¶ Return the interval between BiweeklyPayPeriods as a timedelta.
Returns: interval between BiweeklyPayPeriods Return type: datetime.timedelta
-
period_length
¶ Return the length of a BiweeklyPayPeriod; this is calculated as
period_interval
minus one second.Returns: length of one BiweeklyPayPeriod Return type: datetime.timedelta
-
previous
¶ Return the BiweeklyPayPeriod preceding this one.
Returns: previous BiweeklyPayPeriod before this one Return type: BiweeklyPayPeriod
-
start_date
¶ Return the starting date for this pay period. The period is generally considered to start at midnight (00:00) of this date.
Returns: start date for pay period Return type: datetime.date
-
transactions_list
¶ Return an ordered list of dicts, each representing a transaction for this pay period. Dicts have keys and values as described in
_trans_dict()
.Returns: ordered list of transaction dicts Return type: list
-
biweeklybudget.cliutils module¶
-
biweeklybudget.cliutils.
set_log_debug
(logger)[source]¶ set logger level to DEBUG, and debug-level output format, via
set_log_level_format()
.
-
biweeklybudget.cliutils.
set_log_info
(logger)[source]¶ set logger level to INFO via
set_log_level_format()
.
biweeklybudget.db module¶
-
biweeklybudget.db.
_alembic_get_current_rev
(config, script)[source]¶ Works sorta like alembic.command.current
Parameters: config – alembic Config Returns: current revision Return type: str
-
biweeklybudget.db.
cleanup_db
()[source]¶ This must be called from all scripts, using
atexit.register(cleanup_db)
-
biweeklybudget.db.
db_session
= <sqlalchemy.orm.scoping.scoped_session object>¶
-
biweeklybudget.db.
engine
= Engine(sqlite:///:memory:)¶ The database engine object; return value of
sqlalchemy.create_engine()
.
-
biweeklybudget.db.
init_db
()[source]¶ Initialize the database; call
sqlalchemy.schema.MetaData.create_all()
on the metadata object.
-
biweeklybudget.db.
upsert_record
(model_class, key_fields, **kwargs)[source]¶ Upsert a record in the database.
key_fields
is either a string primary key field name (a key in thekwargs
dict) or a list or tuple of string primary key field names, for compound keys.If a record can be found matching these keys, it will be updated and committed. If not, a new one will be inserted. Either way, the record is returned.
sqlalchemy.orm.session.Session.commit()
is NOT called.Parameters: - model_class (biweeklybudget.models.base.ModelAsDict) – the class of model to insert/update
- key_fields – The field name(s) (keys in
kwargs
) that make up the primary key. This can be a single string, or a list or tuple of strings for compound keys. The values for these key fields MUST be included inkwargs
. - kwargs (dict) – arguments to provide to the model class constructor, or to update if there is an existing record matching the key.
Returns: inserted or updated record; type is an instance of
model_class
biweeklybudget.initdb module¶
biweeklybudget.load_data module¶
biweeklybudget.ofxgetter module¶
-
class
biweeklybudget.ofxgetter.
OfxGetter
(savedir='./')[source]¶ Bases:
object
-
_get_ofx_scraper
(account_name, days=30)[source]¶ Get OFX via a ScreenScraper subclass.
Parameters: Returns: OFX string
Return type:
-
_write_ofx_file
(account_name, ofxdata)[source]¶ Write OFX data to a file.
Parameters: Returns: name of the file that was written
Return type:
-
biweeklybudget.ofxupdater module¶
-
exception
biweeklybudget.ofxupdater.
DuplicateFileException
[source]¶ Bases:
exceptions.Exception
Exception raised when trying to parse a file that has already been parsed for the Account (going by the OFX signon date).
-
class
biweeklybudget.ofxupdater.
OFXUpdater
(acct_id, acct_name, cat_memo=False)[source]¶ Bases:
object
Class to wrap updating the database with a parsed OFX file.
-
_create_statement
(ofx, mtime, filename)[source]¶ Create an OFXStatement for this OFX file. If one already exists with the same account and filename, raise DuplicateFileException.
Parameters: - ofx (
ofxparse.ofxparse.Ofx
) – Ofx instance for parsed file - mtime (datetime.datetime) – OFX file modification time (or current time)
- filename (str) – OFX file name
Returns: the OFXStatement object
Return type: Raises: DuplicateFileException
- ofx (
-
_update_bank_or_credit
(ofx, stmt)[source]¶ Update a single OFX file for this Bank or Credit account.
Parameters: - ofx (
ofxparse.ofxparse.Ofx
) – Ofx instance for parsed file - stmt (biweeklybudget.models.ofx_statement.OFXStatement) – the OFXStatement for this statement
Returns: the OFXStatement object
Return type: - ofx (
-
_update_investment
(ofx, stmt)[source]¶ Update a single OFX file for this Investment account.
Parameters: - ofx (
ofxparse.ofxparse.Ofx
) – Ofx instance for parsed file - stmt (biweeklybudget.models.ofx_statement.OFXStatement) – the OFXStatement for this statement
Returns: the OFXStatement object
Return type: - ofx (
-
update
(ofx, mtime=None, filename=None)[source]¶ Update a single OFX file for this account.
Parameters: - ofx (
ofxparse.ofxparse.Ofx
) – Ofx instance for parsed file - mtime (datetime.datetime) – OFX file modification time (or current time)
- filename (str) – OFX file name
Returns: the OFXStatement created by this run
Return type: - ofx (
-
biweeklybudget.screenscraper module¶
-
class
biweeklybudget.screenscraper.
ScreenScraper
(savedir='./', screenshot=False)[source]¶ Bases:
object
Base class for screen-scraping bank/financial websites.
Load cookies from a JSON cookie file on disk. This file is not the format used natively by PhantomJS, but rather the JSON-serialized representation of the dict returned by
selenium.webdriver.remote.webdriver.WebDriver.get_cookies()
.Cookies are loaded via
selenium.webdriver.remote.webdriver.WebDriver.add_cookie()
Parameters: cookie_file (str) – path to the cookie file on disk
Save cookies to a JSON cookie file on disk. This file is not the format used natively by PhantomJS, but rather the JSON-serialized representation of the dict returned by
selenium.webdriver.remote.webdriver.WebDriver.get_cookies()
.Parameters: cookie_file (str) – path to the cookie file on disk
-
wait_for_ajax_load
(timeout=20)[source]¶ Function to wait for an ajax event to finish and trigger page load, like the Janrain login form.
Pieced together from http://stackoverflow.com/a/15791319
timeout is in seconds
biweeklybudget.settings module¶
-
biweeklybudget.settings.
DB_CONNSTRING
= 'sqlite:///:memory:'¶ string - SQLAlchemy database connection string. See the SQLAlchemy Database URLS docs for further information.
-
biweeklybudget.settings.
DEFAULT_ACCOUNT_ID
= 1¶ int - Account ID to show first in dropdown lists. This must be the database ID of a valid account.
-
biweeklybudget.settings.
PAY_PERIOD_START_DATE
= datetime.date(2017, 3, 17)¶ datetime.date
- The starting date of one pay period (generally the first pay period represented in data in this app). The dates of all pay periods will be determined based on an interval from this date. This must be specified in Y-m-d format (i.e. parsable bydatetime.datetime.strptime()
with%Y-%m-%d
format).
-
biweeklybudget.settings.
RECONCILE_BEGIN_DATE
= datetime.date(2017, 1, 1)¶ datetime.date
- When listing unreconciled transactions that need to be reconciled, any transaction before this date will be ignored. This must be specified in Y-m-d format (i.e. parsable bydatetime.datetime.strptime()
with%Y-%m-%d
format).
-
biweeklybudget.settings.
STALE_DATA_TIMEDELTA
= datetime.timedelta(2)¶ datetime.timedelta
- Time interval beyond which OFX data for accounts will be considered old/stale. This must be specified as a number (integer) that will be converted to a number of days.
-
biweeklybudget.settings.
STATEMENTS_SAVE_PATH
= '/home/docs/ofx'¶ string - (optional) Filesystem path to download OFX statements to, and for backfill_ofx to read them from.
-
biweeklybudget.settings.
TOKEN_PATH
= 'vault_token.txt'¶ string - (optional) Filesystem path to read Vault token from, for OFX credentials.
-
biweeklybudget.settings.
VAULT_ADDR
= 'http://127.0.0.1:8200'¶ string - (optional) Address to connect to Vault at, for OFX credentials.
biweeklybudget.settings_example module¶
-
biweeklybudget.settings_example.
DB_CONNSTRING
= 'sqlite:///:memory:'¶ SQLAlchemy database connection string. Note that the value given in generated documentation is the value used in TravisCI, not the real default.
-
biweeklybudget.settings_example.
DEFAULT_ACCOUNT_ID
= 1¶ Account ID to show first in dropdown lists
-
biweeklybudget.settings_example.
PAY_PERIOD_START_DATE
= datetime.date(2017, 3, 17)¶ The starting date of one pay period. The dates of all pay periods will be determined based on an interval from this date.
-
biweeklybudget.settings_example.
RECONCILE_BEGIN_DATE
= datetime.date(2017, 1, 1)¶ When listing unreconciled transactions that need to be reconciled, any
OFXTransaction
before this date will be ignored.
-
biweeklybudget.settings_example.
STALE_DATA_TIMEDELTA
= datetime.timedelta(2)¶ datetime.timedelta
beyond which OFX data will be considered old
-
biweeklybudget.settings_example.
STATEMENTS_SAVE_PATH
= '/home/docs/ofx'¶ Path to download OFX statements to, and for backfill_ofx to read them from
-
biweeklybudget.settings_example.
TOKEN_PATH
= 'vault_token.txt'¶ Path to read Vault token from, for OFX credentials
-
biweeklybudget.settings_example.
VAULT_ADDR
= 'http://127.0.0.1:8200'¶ Address to connect to Vault at, for OFX credentials
biweeklybudget.utils module¶
-
class
biweeklybudget.utils.
Vault
(addr='http://127.0.0.1:8200', token_path='vault_token.txt')[source]¶ Bases:
object
Provides simpler access to Vault
-
biweeklybudget.utils.
date_suffix
(n)[source]¶ Given an integer day of month (1 <= n <= 31), return that number with the appropriate suffix (st|nd|rd|th).
From: http://stackoverflow.com/a/5891598/211734
Parameters: n (int) – Integer day of month Returns: n with the appropriate suffix Return type: str
-
biweeklybudget.utils.
dtnow
()[source]¶ Return the current datetime as a timezone-aware DateTime object in UTC.
Returns: current datetime Return type: datetime.datetime
-
biweeklybudget.utils.
fix_werkzeug_logger
()[source]¶ Remove the werkzeug logger StreamHandler (call from
app.py
).With Werkzeug at least as of 0.12.1, werkzeug._internal._log sets up its own StreamHandler if logging isn’t already configured. Because we’re using the
flask
command line wrapper, that will ALWAYS be imported (and executed) before we can set up our own logger. As a result, to fix the duplicate log messages, we have to go back and remove that StreamHandler.
biweeklybudget.version module¶
UI JavaScript Docs¶
Files¶
jsdoc.budgets_modal¶
File: biweeklybudget/flaskapp/static/js/budgets_modal.js
-
budgetModal
(id, dataTableObj)¶ Show the modal popup, populated with information for one Budget. Uses
budgetModalDivFillAndShow()
as ajax callback.Arguments: - id (number) – the ID of the Budget to show modal for, or null to show a modal to add a new Budget.
- dataTableObj (Object|null) – passed on to
handleForm()
-
budgetModalDivFillAndShow
(msg)¶ Ajax callback to fill in the modalDiv with data on a budget. Callback for ajax call in
budgetModal()
.
-
budgetModalDivForm
()¶ Generate the HTML for the form on the Modal
-
budgetModalDivHandleType
()¶ Handle change of the “Type” radio buttons on the modal
jsdoc.custom¶
File: biweeklybudget/flaskapp/static/js/custom.js
-
fmt_currency
(value)¶ Format a float as currency
Arguments: - value (number) – the number to format
Returns: string – The number formatted as currency
-
fmt_null
(o)¶ Format a null object as “ ”
Arguments: - o (Object|null) – input value
Returns: Object|string – o if not null,
if null
-
isoformat
(d)¶ Format a javascript Date as ISO8601 YYYY-MM-DD
Arguments: - d (Date) – the date to format
Returns: string – YYYY-MM-DD
jsdoc.forms¶
File: biweeklybudget/flaskapp/static/js/forms.js
-
handleForm
(container_id, form_id, post_url, dataTableObj)¶ Generic function to handle form submission with server-side validation.
See the Python server-side code for further information.
Arguments: - container_id (string) – The ID of the container element (div) that is the visual parent of the form. On successful submission, this element will be emptied and replaced with a success message.
- form_id (string) – The ID of the form itself.
- post_url (string) – Relative URL to post form data to.
- dataTableObj (Object) – passed on to
handleFormSubmitted()
-
handleFormError
(jqXHR, textStatus, errorThrown, container_id, form_id)¶ Handle an error in the HTTP request to submit the form.
-
handleFormSubmitted
(data, container_id, form_id, dataTableObj)¶ Handle the response from the API URL that the form data is POSTed to.
This should either display a success message, or one or more error messages.
Arguments: - data (Object) – response data
- container_id (string) – the ID of the modal container on the page
- form_id (string) – the ID of the form on the page
- dataTableObj (Object) – A reference to the DataTable on the page, that needs to be refreshed. If null, reload the whole page. If a function, call that function. If false, do nothing.
-
isFunction
(functionToCheck)¶ Return True if
functionToCheck
is a function, False otherwise.From: http://stackoverflow.com/a/7356528/211734
Arguments: - functionToCheck (Object) – The object to test.
-
serializeForm
(form_id)¶ Given the ID of a form, return an Object (hash/dict) of all data from it, to POST to the server.
Arguments: - form_id (string) – The ID of the form itself.
jsdoc.ofx¶
File: biweeklybudget/flaskapp/static/js/ofx.js
-
ofxTransModal
(acct_id, fitid)¶ Show the modal popup, populated with information for one OFX Transaction.
jsdoc.payperiod_modal¶
File: biweeklybudget/flaskapp/static/js/payperiod_modal.js
-
schedToTransModal
(id, payperiod_start_date)¶ Show the Scheduled Transaction to Transaction modal popup. This function calls
schedToTransModalDivForm()
to generate the form HTML,schedToTransModalDivFillAndShow()
to populate the form for editing, andhandleForm()
to handle the Submit action.Arguments: - id (number) – the ID of the ScheduledTransaction to show a modal for.
- payperiod_start_date (string) – The Y-m-d starting date of the pay period.
-
schedToTransModalDivFillAndShow
(msg)¶ Ajax callback to fill in the modalDiv with data on a budget.
-
schedToTransModalDivForm
()¶ Generate the HTML for the form on the Modal
jsdoc.reconcile¶
File: biweeklybudget/flaskapp/static/js/reconcile.js
-
clean_fitid
(fitid)¶ Given an OFXTransaction fitid, return a “clean” (alphanumeric) version of it, suitable for use as an HTML element id.
Arguments: - fitid (String) – original, unmodified OFXTransaction fitid.
-
makeTransFromOfx
(acct_id, fitid)¶ Link function to create a Transaction from a specified OFXTransaction, and then reconcile them.
Arguments: - acct_id (Integer) – the OFXTransaction account ID
- fitid (String) – the OFXTransaction fitid
-
makeTransSaveCallback
(data, acct_id, fitid)¶ Callback for the “Save” button on the Transaction modal created by
makeTransFromOfx()
. Displays the new Transaction at the bottom of the Transactions list, then reconciles it with the original OFXTransactionArguments: - data (Object) – response data from POST to /forms/transaction
- acct_id (Integer) – the OFXTransaction account ID
- fitid (String) – the OFXTransaction fitid
-
reconcileDoUnreconcile
(trans_id, acct_id, fitid)¶ Unreconcile a reconciled OFXTransaction/Transaction. This removes
trans_id
from thereconciled
variable, empties the Transaction div’s reconciled div, and shows the OFX div.Arguments: - trans_id (Integer) – the transaction id
- acct_id (Integer) – the account id
- fitid (String) – the FITID
-
reconcileDoUnreconcileNoOfx
(trans_id)¶ Unreconcile a reconciled NoOFX Transaction. This removes
trans_id
from thereconciled
variable and empties the Transaction div’s reconciled div.Arguments: - trans_id (Integer) – the transaction id
-
reconcileGetOFX
()¶ Show unreconciled OFX transactions in the proper div. Empty the div, then load transactions via ajax. Uses
reconcileShowOFX()
as the ajax callback.
-
reconcileGetTransactions
()¶ Show unreconciled transactions in the proper div. Empty the div, then load transactions via ajax. Uses
reconcileShowTransactions()
as the ajax callback.
-
reconcileHandleSubmit
()¶ Handle click of the Submit button on the reconcile view. This POSTs to
/ajax/reconcile
via ajax. Feedback is provided by appending a div with idreconcile-msg
todiv#notifications-row/div.col-lg-12
.
-
reconcileOfxDiv
(trans)¶ Generate a div for an individual OFXTransaction, to display on the reconcile view.
Arguments: - ofxtrans (Object) – ajax JSON object representing one OFXTransaction
-
reconcileShowOFX
(data)¶ Ajax callback handler for
reconcileGetOFX()
. Display the returned data in the proper div.Arguments: - data (Object) – ajax response (JSON array of OFXTransaction Objects)
-
reconcileShowTransactions
(data)¶ Ajax callback handler for
reconcileGetTransactions()
. Display the returned data in the proper div.Sets each Transaction div as
droppable
, usingreconcileTransHandleDropEvent()
as the drop event handler andreconcileTransDroppableAccept()
to test if a draggable is droppable on the element.Arguments: - data (Object) – ajax response (JSON array of Transaction Objects)
-
reconcileTransDiv
(trans)¶ Generate a div for an individual Transaction, to display on the reconcile view.
Arguments: - trans (Object) – ajax JSON object representing one Transaction
-
reconcileTransDroppableAccept
(drag)¶ Accept function for droppables, to determine if a given draggable can be dropped on it.
Arguments: - drag (Object) – the draggable element being dropped.
-
reconcileTransHandleDropEvent
(event, ui)¶ Handler for Drop events on reconcile Transaction divs. Setup as handler via
reconcileShowTransactions()
. This just gets the draggable and the target from theevent
andui
, and then passes them on toreconcileTransactions()
.Arguments: - event (Object) – the drop event
- ui (Object) – the UI element, containing the draggable
-
reconcileTransNoOfx
(trans_id, note)¶ Reconcile a Transaction without a matching OFXTransaction. Called from the Save button handler in
transNoOfx()
.
-
reconcileTransactions
(ofx_div, target)¶ Reconcile a transaction; move the divs and other elements as necessary, and updated the
reconciled
variable.Arguments: - ofx_div (Object) – the OFXTransaction div element (draggable)
- target (Object) – the Transaction div (drop target)
-
transModalOfxFillAndShow
(data)¶ Callback for the GET /ajax/ofx/<acct_id>/<fitid> from
makeTransFromOfx()
. Receives the OFXTransaction data and populates it into the Transaction modal form.Arguments: - data (Object) – OFXTransaction response data
-
transNoOfx
(trans_id)¶ Show the modal for reconciling a Transaction without a matching OFXTransaction. Calls
transNoOfxDivForm()
to generate the modal form div content. Uses an inline function to handle the save action, which callsreconcileTransNoOfx()
to perform the reconcile action.Arguments: - trans_id (number) – the ID of the Transaction
-
transNoOfxDivForm
(trans_id)¶ Generate the modal form div content for the modal to reconcile a Transaction without a matching OFXTransaction. Called by
transNoOfx()
.Arguments: - trans_id (number) – the ID of the Transaction
-
updateReconcileTrans
(trans_id)¶ Trigger update of a single Transaction on the reconcile page.
Arguments: - trans_id (Integer) – the Transaction ID to update.
jsdoc.reconcile_modal¶
File: biweeklybudget/flaskapp/static/js/reconcile_modal.js
-
txnReconcileModal
(id)¶ Show the TxnReconcile modal popup. This function calls
txnReconcileModalDiv()
to generate the HTML.Arguments: - id (number) – the ID of the TxnReconcile to show a modal for.
-
txnReconcileModalDiv
(msg)¶ Ajax callback to generate the modal HTML with reconcile information.
jsdoc.scheduled_modal¶
File: biweeklybudget/flaskapp/static/js/scheduled_modal.js
-
schedModal
(id, dataTableObj)¶ Show the ScheduledTransaction modal popup, optionally populated with information for one ScheduledTransaction. This function calls
schedModalDivForm()
to generate the form HTML,schedModalDivFillAndShow()
to populate the form for editing, andhandleForm()
to handle the Submit action.Arguments: - id (number) – the ID of the ScheduledTransaction to show a modal for, or null to show modal to add a new ScheduledTransaction.
- dataTableObj (Object|null) – passed on to
handleForm()
-
schedModalDivFillAndShow
(msg)¶ Ajax callback to fill in the modalDiv with data on a budget.
-
schedModalDivForm
()¶ Generate the HTML for the form on the Modal
-
schedModalDivHandleType
()¶ Handle change of the “Type” radio buttons on the modal
jsdoc.transactions_modal¶
File: biweeklybudget/flaskapp/static/js/transactions_modal.js
-
transModal
(id, dataTableObj)¶ Show the ScheduledTransaction modal popup, optionally populated with information for one ScheduledTransaction. This function calls
schedModalDivForm()
to generate the form HTML,schedModalDivFillAndShow()
to populate the form for editing, andhandleForm()
to handle the Submit action.Arguments: - id (number) – the ID of the ScheduledTransaction to show a modal for, or null to show modal to add a new ScheduledTransaction.
- dataTableObj (Object|null) – passed on to
handleForm()
-
transModalDivFillAndShow
(msg)¶ Ajax callback to fill in the modalDiv with data on a budget.
-
transModalDivForm
()¶ Generate the HTML for the form on the Modal