luthor
A simple library to parse XML.
About
Luthor utilizes all efficient tricks from pholcidae to make XML parsing as simple as never before. Luthor uses lxml's iterable parsing mechanism to parse files of any size.
Dependencies
- python 3
- lxml
Basic example
from luthor import Luthor
class MyParser(Luthor):
def get_record(self, data):
print(data)
settings = {
'source': 'http://www.w3schools.com/xml/simple.xml',
'tag': 'food',
'threads': 3,
}
parser = MyParser()
parser.extend(settings)
parser.start()
Allowed settings
Settings must be passed as dictionary to extend() method of the parser.
Params you can use:
Required
- source string - a path to file or URL with XML content.
- tag string - XML tag to start from.
Additional
- threads int - number of threads of parser. Default:
1 - with_lock bool - wheither or not must parser use lock while data sync. It slightly decreases parsing speed but eliminates race conditions. Default:
True - strip_namespaces bool - wheither or not must parser remove namespaces from tag names before return data. Default:
False - start_line int - starting from which line parser will start to send results to callback function. Default:
1
Response attributes
While inherit Luthor class you can override built-in get_record() method to retrieve data gathered from tag.
- _attrs dict - Attributes of tag. You can also use alias method
attrs(). Default:{} - _content str - Content of tag. You can also use alias method
content(). Default:'' - child tags - child tags includes into parent tag dict under corresponding keys. Default:
[]
Tips and tricks
- Use
.content(),.attrs()and.attr('attr_name')to get corresponding data from result tags. - You can also use methods listed above on lists of tags. In this case you will get corresponding data from first tag in list.
- Tags lists also have two special methods
.children('tag_name')and.child('tag_name'). Children method will return children tags under corresponding key for first parent tag in list. Child method is a shorthand to children. - You can use
last_line()parser method to get line number of last accessed tag as pass it again to new instance of parser in case of some fatal exception or error.
