Repository navigation

Add full FinTS parser. - #34

Merged

raphaelm merged 162 commits into

raphaelm:masterfrom

henryk:fints-parser

Dec 7, 2018

Commits on Dec 3, 2018

Add full FinTS parser. Significantly changes the internal API, as segments are now lists of lists.

henryk
authored and
raphaelm
committed
cca60a9
New-style object oriented interface

henryk
authored and
raphaelm
committed
5444d53
Do not ignore tests

henryk
authored and
raphaelm
committed
bd6acd9
Make SegmentHeader output shorter

henryk
authored and
raphaelm
committed
ab7c6f0
Test eval of repr() output

henryk
authored and
raphaelm
committed
53c1044
Only ignore non-present fields if they're not required

henryk
authored and
raphaelm
committed
04b5fdb
Implement rendering for most fields

henryk
authored and
raphaelm
committed
ec9ac5b
Shorten output by suppressing unset and optional fields

henryk
authored and
raphaelm
committed
88ab2f0
Add HNSHA2 and HIRMG2, trigger parser incompleteness

henryk
authored and
raphaelm
committed
08701a0
Add test for parsing of count-repeated fields

henryk
authored and
raphaelm
committed
2922381
Fix logic error in counted elements parser, can now parse HIRMG2

henryk
authored and
raphaelm
committed
aa651c3
Improve nested output of ValueList fields

henryk
authored and
raphaelm
committed
ecf4aa4
More edge cases

henryk
authored and
raphaelm
committed
4916b18
Check that FinTS3Segments only have DE or DEG fields

henryk
authored and
raphaelm
committed
a688049
Fix parser for repeated and nested elements. Again.

henryk
authored and
raphaelm
committed
4006232
Implement HIUPA4 and HIUPD6

henryk
authored and
raphaelm
committed
9c5fb1b
Automatically trim ValueList with non-fixed length to minimum length (change tests to reflect that behaviour)

henryk
authored and
raphaelm
committed
4ce9462
Ignore end-of-sequence for open-end multiple fields

henryk
authored and
raphaelm
committed
1f03580
Make error exceptions more helpful

henryk
authored and
raphaelm
committed
a3de7d7
Implement HITANS3

henryk
authored and
raphaelm
committed
d501b64
Nicer exception stack traces, again

henryk
authored and
raphaelm
committed
c20436a
Implement HIPINS1

henryk
authored and
raphaelm
committed
84c0be1
Fix field inheritance over more than one level

henryk
authored and
raphaelm
committed
a61f0d2
More DRY, less repeating

henryk
authored and
raphaelm
committed
aae31db
First working serializer

henryk
authored and
raphaelm
committed
c0cd07e
Add tests for serializer

henryk
authored and
raphaelm
committed
6599f46
ValueList cannot actually contain another ValueList

henryk
authored and
raphaelm
committed
b8610c8
flat_length_max is not used anymore

henryk
authored and
raphaelm
committed
70ea372
Improve test coverage slightly

henryk
authored and
raphaelm
committed
9f65c1a
Implement more generic Field types

henryk
authored and
raphaelm
committed
c8ac15b
Rename old FinTS3Segment to FinTS3SegmentOLD for coexistence with old code

henryk
authored and
raphaelm
committed
c447c45
Add a PasswordField, fix BooleanField, fix some class definitions

henryk
authored and
raphaelm
committed
f9fdb36
Add missing escaping (systemid sometimes has a +)

henryk
authored and
raphaelm
committed
d70c763
Experimental: print new parse for all incoming and outgoing messages

henryk
authored and
raphaelm
committed
f698453
account_information in HIUPD6 is conditional

henryk
authored and
raphaelm
committed
375fd0d
Add some developer documentation

henryk
authored and
raphaelm
committed
a27704a
Update documentation

henryk
authored and
raphaelm
committed
d04c6a1
Fix and document serializer

henryk
authored and
raphaelm
committed
2af2fb9
Include code in docs, more docs

henryk
authored and
raphaelm
committed
09f1d6b
Implement finding

henryk
authored and
raphaelm
committed
ae7fc01
Put test cases into files, parametrize test cases

henryk
authored and
raphaelm
committed
32bc652
Work towards getting FinTS3Segment used in the normal flow.

henryk
authored and
raphaelm
committed
a9433cd
Change Model: make all ParameterSegment subclasses "parameters" field singular

henryk
authored and
raphaelm
committed
8d6833e
Implement HITANS segments

henryk
authored and
raphaelm
committed
d906195
get_sepa_accounts() working

henryk
authored and
raphaelm
committed
a98acfd
Improve documentation

henryk
authored and
raphaelm
committed
b9d0449
Escape and unescape character @

Romain Rinie
authored and
raphaelm
committed
7b6ef54
Allow querying by class instead of segment type name

henryk
authored and
raphaelm
committed
f8624c0
Cleanup autodoc, generate type information for all the fields

henryk
authored and
raphaelm
committed
51eb938
Add a 'robust mode': A parse error during interpretation of a segment will be turned into a Warning, and a generic object will be created.

henryk
authored and
raphaelm
committed
43183dc
Apply isort, remove unused imports

henryk
authored and
raphaelm
committed
ec8f8a9
Split into fints.types (internal and custom types), fints.fields (fields to be used in creating segments) and fints.segments.

henryk
authored and
raphaelm
committed
d49758b
Move Mixins to utils to get them out of the autodoc

henryk
authored and
raphaelm
committed
aeacd83
Improve documentation

henryk
authored and
raphaelm
committed
c5e9d75
Add date/time fields

henryk
authored and
raphaelm
committed
3fe90f1
Add a bad hack to RepresentableEnum to get docstrings on enum members. Make the documented output better

henryk
authored and
raphaelm
committed
4b08192
Fix tests for new field names

henryk
authored and
raphaelm
committed
ca3fc11
More docs

henryk
authored and
raphaelm
committed
3789fa6
Implement/doc more fields

henryk
authored and
raphaelm
committed
0838fce
Add ZeroPaddedNumericField, Fix BooleanField._parse_value

henryk
authored and
raphaelm
committed
c3e7b14
Convert get_sepa_accounts() and get_balance() to new API. Move segments around. Implement new types.

henryk
authored and
raphaelm
committed
4f4d0d8
(Re-)Add one step PIN mechanism

henryk
authored and
raphaelm
committed
f5e2db4
Make TwoStep (without TAN) work again

henryk
authored and
raphaelm
committed
23d0278
Implement HKSAL5/HISAL5

henryk
authored and
raphaelm
committed
e26338a
Run isort

henryk
authored and
raphaelm
committed
c7feda9
Improve BPD and UPD: Is now SegmentSequence, allows full querying.

henryk
authored and
raphaelm
committed
0b7619f
(Re-)implement get_statement() in new API

henryk
authored and
raphaelm
committed
2d703f0
Improve dialog handling: Drastically reduce latancy.

henryk
authored and
raphaelm
committed
b3d8a77
Make touchdown fetching reusable

henryk
authored and
raphaelm
committed
11557f5
Make _find_highest_command reusable

henryk
authored and
raphaelm
committed
40762ee
Simply _find_highest_command() API. Implement get_holdings() (untested).

henryk
authored and
raphaelm
committed
1a66476
Implement get_tan_descriptions()

henryk
authored and
raphaelm
committed
91d93b5
Allow FinTS3Client state (system id, BPD, optionally: UPD) to be saved and restored.

henryk
authored and
raphaelm
committed
14ff4fb
Implement automatic security_function choosing, implement H[IK]TAN[56] segments

henryk
authored and
raphaelm
committed
fdb584e
Allow pausing and resuming of dialogs

henryk
authored and
raphaelm
committed
8e752bb
Work towards SEPA transfers

henryk
authored and
raphaelm
committed
2366f6d
Whip logging into shape

henryk
authored and
raphaelm
committed
2164250
Add set_product()

henryk
authored and
raphaelm
committed
82cdde9
First working transfer

henryk
authored and
raphaelm
committed
614ee70
Move all of the PIN/TAN specific handling into FinTS3PinTanClient

henryk
authored and
raphaelm
committed
198658a
Implement NeedTANResponse.get_data()/.from_data()

henryk
authored and
raphaelm
committed
324d2af
Further shuffle send abstractions around. Transfer should be OK now.

henryk
authored and
raphaelm
committed
13e7f52
Fix a parser bug found in real data

henryk
authored and
raphaelm
committed
9c08ae0
Make it possible to open an anonymous dialogue (user_id=CUSTOMER_ID_ANONYMOUS, pin=None)

henryk
authored and
raphaelm
committed
06a3f1c
Remove references to OLD in client.

henryk
authored and
raphaelm
committed
183abea
Remove most references to OLD

henryk
authored and
raphaelm
committed
60dd219
First working debit (multiple, COR1)

henryk
authored and
raphaelm
committed
2106083
Remove last OLD

henryk
authored and
raphaelm
committed
e6de833
Change sorting of segment classes

henryk
authored and
raphaelm
committed
a8de83e
Add querying of scheduled debits (untested, my bank doesn't support it)

henryk
authored and
raphaelm
committed
c6501f2
Implement querying the status protocol

henryk
authored and
raphaelm
committed
fdec080
Fix bugs found when talking to banks

henryk
authored and
raphaelm
committed
235aca1
Add DKKKU based on a cursory reverse engineering and guessing. Untested though

henryk
authored and
raphaelm
committed
44f2fa8
Remove old code

henryk
authored and
raphaelm
committed
4e75fcf
Implement get_information()

henryk
authored and
raphaelm
committed
6fd4d22
Fix bugs found in communication with bank

henryk
authored and
raphaelm
committed
ecb8275
Deliberately break API. start_sepa_... is now sepa_...

henryk
authored and
raphaelm
committed
1df024b
Also give information about supported SEPA PAIN formats

henryk
authored and
raphaelm
committed
110cea9
Add single COR1 debit

henryk
authored and
raphaelm
committed
3cc589d
Fix test for changed Exception type.

henryk
authored and
raphaelm
committed
9432065
Fix wrong field counts

henryk
authored and
raphaelm
committed
1c2ffda
Fix SEPA_TRANSFER operations type

henryk
authored and
raphaelm
committed
d3f3284
Elide empty items at the end of a ValueList with a fixed (minimum) length

henryk
authored and
raphaelm
committed
b3a4e63
Add forgotten journal segments file

henryk
authored and
raphaelm
committed
95629a0
Pool Exceptions in one module

henryk
authored and
raphaelm
committed
c3872bc
Continue breaking API: statement -> transactions, to prepare the API for fetching of actual statements ("Kontoauszug")

henryk
authored and
raphaelm
committed
c43e50f
Return 'auth' information in FinTSPinTanClient.get_information()

henryk
authored and
raphaelm
committed
bd7f608
Introduce TransactionResponse object.

henryk
authored and
raphaelm
committed
95a986b
Parse TAN request for embedded optical data (CHLGUC), provide safe HTML challenge

henryk
authored and
raphaelm
committed
d484148
Work on flicker code/hhduc parsing, make it work with my Sparkasse

henryk
authored and
raphaelm
committed
c507d33
Shuffle segments around

henryk
authored and
raphaelm
committed
d6eef2f
Use duck typing to break dependency hell

henryk
authored and
raphaelm
committed
bd61980
Move Field into types (next to Container) to simplify dependency hell

henryk
authored and
raphaelm
committed
7c9e250
Fully solve dependencies, I think. Run isort, cleanup imports

henryk
authored and
raphaelm
committed
bb8baeb
Remove dead code

henryk
authored and
raphaelm
committed
1ce6142
Add forgotten file

henryk
authored and
raphaelm
committed
9795be6
Add dummy server for client test. Now have full back to back test

henryk
authored and
raphaelm
committed
6a357b8
Test for dialog resumption

henryk
authored and
raphaelm
committed
d27dc1b
Test get_information()

henryk
authored and
raphaelm
committed
88a6435
Add 1step transfer test

henryk
authored and
raphaelm
committed
43a0e41
Fix bug in sepa transfer

henryk
authored and
raphaelm
committed
99cece1
Shorten the serializer output on level 2 (mostly in use in HIUPD, which has a field with count=999)

henryk
authored and
raphaelm
committed
bc7b126
Test 2step transfer

henryk
authored and
raphaelm
committed
dd86add
Test wrong authentication data

henryk
authored and
raphaelm
committed
aee0a58
End-to-end test HHDUC

henryk
authored and
raphaelm
committed
a41c61f
Test for get_data/from_data with NeedRetryResponse

henryk
authored and
raphaelm
committed
7336da1
Add test for get_transactions and for fetching with touchdowns

henryk
authored and
raphaelm
committed
ff8e682
Clean unused code

henryk
authored and
raphaelm
committed
845045c
Re-shuffle docs, document new client stuff

henryk
authored and
raphaelm
committed
3049f29
Update docs

henryk
authored and
raphaelm
committed
679ac20
Add decoding of matrix like challenges (PhotoTAN). Fully untested

henryk
authored and
raphaelm
committed
ee777d5
Improve documentation

henryk
authored and
raphaelm
committed
6bb2d9a
Bump version (for pip installation)

henryk
authored and
raphaelm
committed
813fed2
Fix a syntax error in documentation
raphaelm
committed
4806aa0
Throw a custom exception on unsupported operation
raphaelm
committed
77a6a05
Replace another ValueError with FinTSUnsupportedOperation
raphaelm
committed
343fbcc
Unify code style
raphaelm
committed
292306c
Use actual library version for product_version
raphaelm
committed
4eb5778
More code style improvements
raphaelm
committed
92817fb
Fix bugs found by linter
raphaelm
committed
37b7bd9
HKVVB3.product_version is limited to 5 characters.

henryk
authored and
raphaelm
committed
b1cb72c
Fix a FIXME (by turning it into a note)

henryk
authored and
raphaelm
committed
e05a2f2
Pass PAIN messages as bytes
raphaelm
committed
6893227
Allow passing Decimals to FloatField
raphaelm
committed
f44cede
For KTI, we should not pass legacy bank information if we have SEPA
raphaelm
committed
125baf0
Add .travis.yml
raphaelm
committed
40465ed
Fixes for Travis CI
raphaelm
committed
4436b0f
Fix simple transfers
raphaelm
committed
ca3b596
Use American English consistently (sorry!)
raphaelm
committed
8f3ff51
Minor naming improvements
raphaelm
committed
a723fc9
Remove unused code
raphaelm
committed
56235ff
Add pytest-mock to travis dependencies
raphaelm
committed
f14d937
Rename get_data/set_data to deconstruct/from_data
raphaelm
committed
4b20005
Remove superfluous parameters
raphaelm
committed
af36b5f
Add coverage configuration
raphaelm
committed
26bea9c
Remove a FIXME that appears to be resolved already
raphaelm
committed
4cf28ae
Improve documentation
raphaelm
committed
0a73c5a
Adjust credits
raphaelm
committed
df73e5e