django - Converting and Unifying API data in Python -


i'm trying pull similar data in several third party apis, of have varying schemas, , convert them unified schema store in db , expose through unified api. re-write of system this, minus storing in db, hard test , not elegant. figured i'd turn community wisdom. here thoughts/what i'd achieve.

  • an easy way specify schema mappings external apis schema internal schema. realize nuances in data might lost converting unified schema, that's life. schema mapping might not easy , perhaps overkill academic papers i've found on matter.
  • an alternative solution allow third parties develop interfaces external apis. code quality of these third parties may or may not known, established via thorough tests.
  • therefore system should easy test, i'm thinking mocking external api calls have reproducible data , ensure parsing , conversion being done correctly.
  • one of external api interfaces crashing should not bring down rest of them.
  • some sort of schema validation/way detect if external api schemas have changed without warning
  • this end being integrated django project, written django app, make unit , integration testing easier. on other hand, keep decoupled possible django. although api interfaces have know format convert to, specified @ runtime?

am missing in wishlist? unrealistic? headed down wrong path? love feedback.

i'm not sure if there libraries/os project of this. less wheels have reinvent better. part of valuable os project?

in previous version spawned bunch of threads handle individual requests. although i've never used it, i've been told should @ gevent way handle this.

for second bullet point should check out temboo. temboo normalizes access on 100 apis, meaning can talk them using common syntax in language of choice. in case use temboo python sdk - available here.

(full disclosure: work @ temboo)


Comments

Post a Comment

Popular posts from this blog

monitor web browser programmatically in Android? -

i've got tricky question here. need users make payment bank (namely barclaycard) in uk. so, have https url , add parameters (such amount pay, order reference, etc) url, start http connection intent.actionview, redirect user browser can enter credit card details on bank's webpage , make payment our account successfully. far ? the code use below (i changed values privacy reasons) problem is, need app when user has completed/failed/cancelled payment. barclaycardautomatically redirects particular url when payment has succeeded, 1 if failed. there no way of knowing when barclaycard payment has succeeded go android app somehow ? button cardbutton = (button) findviewbyid(r.id.card_button); cardbutton.setonclicklistener(new view.onclicklistener() { @override public void onclick(view arg0) { string prehashstring = new string(); string prohashstring = new string(); string shapassphrase = new string(); shapassphrase = "gsvth£h70zkh...
Read more

Shrink a YouTube video to responsive width -

i have youtube video embedded on our website , when shrink screen tablet or phone sizes stops shrinking @ around 560px in width. standard youtube videos or there can add code make go smaller? you can make youtube videos responsive css. wrap iframe in div class of "videowrapper" , apply following styles: .videowrapper { float: none; clear: both; width: 100%; position: relative; padding-bottom: 56.25%; padding-top: 25px; height: 0; } .videowrapper iframe { position: absolute; top: 0; left: 0; width: 100%; height: 100%; } the .videowrapper div should inside responsive element. padding on .videowrapper necessary keep video collapsing. may have tweak numbers depending upon layout.
Read more

wpf - PdfWriter.GetInstance throws System.NullReferenceException -

i'm trying create pdf document using itextsharp 5.3.4 using following document document = new document(); filestream stm = new filestream(filename, filemode.create); pdfwriter writer = pdfwriter.getinstance(document, stm); i'm getting system.nullreferenceexception following stack trace: system.nullreferenceexception occurred hresult=-2147467261 message=la référence d'objet n'est pas définie à une instance d'un objet. source=itextsharp stacktrace: à itextsharp.text.version.getinstance() innerexception: i've verified neither document nor stm null, , if select "continue" in vs12 document created - exception thrown. updated itextsharp 5.4.0 , it's still occurring. can't find information on anywhere - got ideas? make sure not catching exceptions. nullreferenceexception can 1 caught , handled inside itextsharp, don't care it. fact can continue supports theory. change following setting verify: debug -> exceptions ...
Read more