Comprehensive Python Cheatsheet =============================== [Download text file](https://raw.githubusercontent.com/gto76/python-cheatsheet/master/README.md), [Fork me on GitHub](https://github.com/gto76/python-cheatsheet) or [Check out FAQ](https://github.com/gto76/python-cheatsheet/wiki/Frequently-Asked-Questions). ![Monty Python](web/image_888.jpeg) Contents -------- **   ** **1. Collections:** ** ** **[`List`](#list)**__,__ **[`Dictionary `](#dictionary)**__,__ **[`Set`](#set)**__,__ **[`Tuple`](#tuple)**__,__ **[`Range`](#range)**__,__ **[`Enumerate`](#enumerate)**__,__ **[`Iterator`](#iterator)**__,__ **[`Generator`](#generator)**__.__ **   ** **2. Types:** **          ** **[`Type`](#type)**__,__ **[`String`](#string)**__,__ **[`Regular_Exp`](#regex)**__,__ **[`Format`](#format)**__,__ **[`Numbers`](#numbers)**__,__ **[`Combinatorics`](#combinatorics)**__,__ **[`Datetime`](#datetime)**__.__ **   ** **3. Syntax:** **         ** **[`Args`](#arguments)**__,__ **[`Inline`](#inline)**__,__ **[`Closure`](#closure)**__,__ **[`Decorator`](#decorator)**__,__ **[`Class`](#class)**__,__ **[`Duck_Types`](#duck-types)**__,__ **[`Enum`](#enum)**__,__ **[`Exceptions`](#exceptions)**__.__ **   ** **4. System:** **        ** **[`Print`](#print)**__,__ **[`Input`](#input)**__,__ **[`Command_Line_Arguments`](#command-line-arguments)**__,__ **[`Open`](#open)**__,__ **[`Path`](#path)**__,__ **[`Command_Execution`](#command-execution)**__.__ **   ** **5. Data:** **             ** **[`CSV`](#csv)**__,__ **[`JSON`](#json)**__,__ **[`Pickle`](#pickle)**__,__ **[`SQLite`](#sqlite)**__,__ **[`Bytes`](#bytes)**__,__ **[`Struct`](#struct)**__,__ **[`Array`](#array)**__,__ **[`MemoryView`](#memory-view)**__,__ **[`Deque`](#deque)**__.__ **   ** **6. Advanced:** **   ** **[`Threading`](#threading)**__,__ **[`Introspection`](#introspection)**__,__ **[`Metaprograming`](#metaprograming)**__,__ **[`Operator`](#operator)**__,__ **[`Eval`](#eval)**__,__ **[`Coroutine`](#coroutine)**__.__ **   ** **7. Libraries:** **      ** **[`Progress_Bar`](#progress-bar)**__,__ **[`Plot`](#plot)**__,__ **[`Table`](#table)**__,__ **[`Curses`](#curses)**__,__ **[`Logging`](#logging)**__,__ **[`Scraping`](#scraping)**__,__ **[`Web`](#web)**__,__ **[`Profile`](#profile)**__,__ **                                 ** **[`NumPy`](#numpy)**__,__ **[`Image`](#image)**__,__ **[`Audio`](#audio)**__.__ Main ---- ```python if __name__ == '__main__': # Runs main() if file wasn't imported. main() ``` List ---- ```python = [from_inclusive : to_exclusive : ±step_size] ``` ```python .append() # Or: += [] .extend() # Or: += ``` ```python .sort() .reverse() = sorted() = reversed() ``` ```python sum_of_elements = sum() elementwise_sum = [sum(pair) for pair in zip(list_a, list_b)] sorted_by_second = sorted(, key=lambda el: el[1]) sorted_by_both = sorted(, key=lambda el: (el[1], el[0])) flatter_list = list(itertools.chain.from_iterable()) product_of_elems = functools.reduce(lambda out, x: out * x, ) list_of_chars = list() ``` ```python index = .index() # Returns index of first occurrence or raises ValueError. .insert(index, ) # Inserts item at index and moves the rest to the right. = .pop([index]) # Removes and returns item at index or from the end. .remove() # Removes first occurrence of item or raises ValueError. .clear() # Removes all items. Also works on dict and set. ``` Dictionary ---------- ```python = .keys() # Coll. of keys that reflects changes. = .values() # Coll. of values that reflects changes. = .items() # Coll. of key-value tuples. ``` ```python value = .get(key, default=None) # Returns default if key does not exist. value = .setdefault(key, default=None) # Same, but also adds default to dict. = collections.defaultdict() # Creates a dict with default value of type. = collections.defaultdict(lambda: 1) # Creates a dict with default value 1. ``` ```python .update() = dict() # Creates a dict from coll. of key-value pairs. = dict(zip(keys, values)) # Creates a dict from two collections. = dict.fromkeys(keys [, value]) # Creates a dict from collection of keys. ``` ```python value = .pop(key) # Removes item from dictionary. {k: v for k, v in .items() if k in keys} # Filters dictionary by keys. ``` ### Counter ```python >>> from collections import Counter >>> colors = ['red', 'blue', 'yellow', 'blue', 'red', 'blue'] >>> counter = Counter(colors) Counter({'blue': 3, 'red': 2, 'yellow': 1}) >>> counter.most_common()[0] ('blue', 3) ``` Set --- ```python = set() ``` ```python .add() # Or: |= {} .update() # Or: |= ``` ```python = .union() # Or: | = .intersection() # Or: & = .difference() # Or: - = .symmetric_difference() # Or: ^ = .issubset() # Or: <= = .issuperset() # Or: >= ``` ```python .remove() # Raises KeyError. .discard() # Doesn't raise an error. ``` ### Frozen Set * **Is immutable and hashable.** * **That means it can be used as a key in a dictionary or as an element in a set.** ```python = frozenset() ``` Tuple ----- **Tuple is an immutable and hashable list.** ```python = () = (, ) = (, , ...) ``` ### Named Tuple **Tuple's subclass with named elements.** ```python >>> from collections import namedtuple >>> Point = namedtuple('Point', 'x y') >>> p = Point(1, y=2) Point(x=1, y=2) >>> p[0] 1 >>> p.x 1 >>> getattr(p, 'y') 2 >>> p._fields # Or: Point._fields ('x', 'y') ``` Range ----- ```python = range(to_exclusive) = range(from_inclusive, to_exclusive) = range(from_inclusive, to_exclusive, ±step_size) ``` ```python from_inclusive = .start to_exclusive = .stop ``` Enumerate --------- ```python for i, el in enumerate( [, i_start]): ... ``` Iterator -------- ```python = iter() # Calling `iter()` returns unmodified iterator. = iter(, to_exclusive) # Sequence of return values until 'to_exclusive'. = next( [, default]) # Raises StopIteration or returns 'default' on end. ``` ### Itertools ```python from itertools import count, repeat, cycle, chain, islice ``` ```python = count(start=0, step=1) # Returns incremented value endlessly. = repeat( [, times]) # Returns element endlessly or 'times' times. = cycle() # Repeats the sequence indefinitely. ``` ```python = chain(, [, ...]) # Empties collections in order. = chain.from_iterable() # Empties collections inside a collection in order. ``` ```python = islice(, to_exclusive) = islice(, from_inclusive, to_exclusive) = islice(, from_inclusive, to_exclusive, +step_size) ``` Generator --------- * **Convenient way to implement the iterator protocol.** * **Any function that contains a yield statement returns a generator object.** * **Generators and iterators are interchangeable.** ```python def count(start, step): while True: yield start start += step ``` ```python >>> counter = count(10, 2) >>> next(counter), next(counter), next(counter) (10, 12, 14) ``` Type ---- * **Everything is an object.** * **Every object has a type.** * **Type and class are synonymous.** ```python = type() # Or: .__class__ = isinstance(, ) # Or: issubclass(type(), ) ``` ```python >>> type('a'), 'a'.__class__, str (, , ) ``` #### Some types do not have builtin names, so they must be imported: ```python from types import FunctionType, MethodType, LambdaType, GeneratorType ``` ### ABC **An abstract base class introduces virtual subclasses, that don’t inherit from it but are still recognized by isinstance() and issubclass().** ```python >>> from collections.abc import Sequence, Collection, Iterable >>> isinstance([1, 2, 3], Iterable) True ``` ```text +------------------+----------+------------+----------+ | | Sequence | Collection | Iterable | +------------------+----------+------------+----------+ | list, range, str | yes | yes | yes | | dict, set | | yes | yes | | iter | | | yes | +------------------+----------+------------+----------+ ``` ```python >>> from numbers import Integral, Rational, Real, Complex, Number >>> isinstance(123, Number) True ``` ```text +--------------------+----------+----------+------+---------+--------+ | | Integral | Rational | Real | Complex | Number | +--------------------+----------+----------+------+---------+--------+ | int | yes | yes | yes | yes | yes | | fractions.Fraction | | yes | yes | yes | yes | | float | | | yes | yes | yes | | complex | | | | yes | yes | +--------------------+----------+----------+------+---------+--------+ ``` String ------ ```python = .strip() # Strips all whitespace characters from both ends. = .strip('') # Strips all passed characters from both ends. ``` ```python = .split() # Splits on one or more whitespace characters. = .split(sep=None, maxsplit=-1) # Splits on 'sep' str at most 'maxsplit' times. = .splitlines(keepends=False) # Splits on line breaks. Keeps them if 'keepends'. = .join() # Joins elements using string as separator. ``` ```python = in # Checks if string contains a substring. = .startswith() # Pass tuple of strings for multiple options. = .endswith() # Pass tuple of strings for multiple options. = .find() # Returns start index of first match or -1. = .index() # Same but raises ValueError. ``` ```python = .replace(old, new [, count]) # Replaces 'old' with 'new' at most 'count' times. = .isnumeric() # True if str contains only numeric characters. = textwrap.wrap(, width) # Nicely breaks string into lines. ``` * **Also: `'lstrip()'`, `'rstrip()'`.** * **Also: `'lower()'`, `'upper()'`, `'capitalize()'` and `'title()'`.** ### Char ```python = chr() # Converts int to unicode char. = ord() # Converts unicode char to int. ``` ```python >>> ord('0'), ord('9') (48, 57) >>> ord('A'), ord('Z') (65, 90) >>> ord('a'), ord('z') (97, 122) ``` Regex ----- ```python import re = re.sub(, new, text, count=0) # Substitutes all occurrences. = re.findall(, text) # Returns all occurrences. = re.split(, text, maxsplit=0) # Use brackets in regex to keep the matches. = re.search(, text) # Searches for first occurrence of pattern. = re.match(, text) # Searches only at the beginning of the text. = re.finditer(, text) # Returns all occurrences as match objects. ``` * **Argument `'flags=re.IGNORECASE'` can be used with all functions.** * **Argument `'flags=re.MULTILINE'` makes `'^'` and `'$'` match the start/end of each line.** * **Argument `'flags=re.DOTALL'` makes dot also accept newline.** * **Use `r'\1'` or `'\\1'` for backreference.** * **Use `'?'` to make an operator non-greedy.** ### Match Object ```python = .group() # Whole match. Also group(0). = .group(1) # Part in first bracket. = .groups() # All bracketed parts. = .start() # Start index of a match. = .end() # Exclusive end index of a match. ``` ### Special Sequences * **By default digits, whitespaces and alphanumerics from all alphabets are matched, unless `'flags=re.ASCII'` argument is used.** * **Use capital letters for negation.** ```python '\d' == '[0-9]' # Digit '\s' == '[ \t\n\r\f\v]' # Whitespace '\w' == '[a-zA-Z0-9_]' # Alphanumeric ``` Format ------ ```python = f'{}, {}' = '{}, {}'.format(, ) ``` ### Attributes ```python >>> from collections import namedtuple >>> Person = namedtuple('Person', 'name height') >>> person = Person('Jean-Luc', 187) >>> f'{person.height}' '187' >>> '{p.height}'.format(p=person) '187' ``` ### General Options ```python {:<10} # ' ' {:^10} # ' ' {:>10} # ' ' ``` ```python {:.<10} # '......' {:>0} # '' ``` ### Strings **`'!r'` calls object's repr() method, instead of str(), to get a string.** ```python {'abcde'!r:<10} # "'abcde' " {'abcde':.3} # 'abc' {'abcde':10.3} # 'abc ' ``` ### Numbers ```python { 123456:10,} # ' 123,456' { 123456:10_} # ' 123_456' { 123456:+10} # ' +123456' {-123456:=10} # '- 123456' { 123456: } # ' 123456' {-123456: } # '-123456' ``` ### Floats ```python {1.23456:10.3} # ' 1.23' {1.23456:10.3f} # ' 1.235' {1.23456:10.3e} # ' 1.235e+00' {1.23456:10.3%} # ' 123.456%' ``` #### Comparison of float presentation types: ```text +----------------+----------------+---------------+----------------+-----------------+ | | {} | {:f} | {:e} | {:%} | +----------------+----------------+---------------+----------------+-----------------+ | 0.000056789 | '5.6789e-05' | '0.000057' | '5.678900e-05' | '0.005679%' | | 0.00056789 | '0.00056789' | '0.000568' | '5.678900e-04' | '0.056789%' | | 0.0056789 | '0.0056789' | '0.005679' | '5.678900e-03' | '0.567890%' | | 0.056789 | '0.056789' | '0.056789' | '5.678900e-02' | '5.678900%' | | 0.56789 | '0.56789' | '0.567890' | '5.678900e-01' | '56.789000%' | | 5.6789 | '5.6789' | '5.678900' | '5.678900e+00' | '567.890000%' | | 56.789 | '56.789' | '56.789000' | '5.678900e+01' | '5678.900000%' | | 567.89 | '567.89' | '567.890000' | '5.678900e+02' | '56789.000000%' | +----------------+----------------+---------------+----------------+-----------------+ ``` ```text +----------------+----------------+---------------+----------------+-----------------+ | | {:.2} | {:.2f} | {:.2e} | {:.2%} | +----------------+----------------+---------------+----------------+-----------------+ | 0.000056789 | '5.7e-05' | '0.00' | '5.68e-05' | '0.01%' | | 0.00056789 | '0.00057' | '0.00' | '5.68e-04' | '0.06%' | | 0.0056789 | '0.0057' | '0.01' | '5.68e-03' | '0.57%' | | 0.056789 | '0.057' | '0.06' | '5.68e-02' | '5.68%' | | 0.56789 | '0.57' | '0.57' | '5.68e-01' | '56.79%' | | 5.6789 | '5.7' | '5.68' | '5.68e+00' | '567.89%' | | 56.789 | '5.7e+01' | '56.79' | '5.68e+01' | '5678.90%' | | 567.89 | '5.7e+02' | '567.89' | '5.68e+02' | '56789.00%' | +----------------+----------------+---------------+----------------+-----------------+ ``` ### Ints ```python {90:c} # 'Z' {90:X} # '5A' {90:b} # '1011010' ``` Numbers ------- ```python = int() # Or: math.floor() = float() = complex(real=0, imag=0) # Or: + j = fractions.Fraction(numerator=0, denominator=1) ``` * **`'int()'` and `'float()'` raise 'ValueError' on malformed strings.** ### Basic Functions ```python = pow(, ) # Or: ** = abs() = round() = round(, ±ndigits) # `round(126, -1) == 130` ``` ### Math ```python from math import e, pi, inf, nan from math import cos, acos, sin, asin, tan, atan, degrees, radians from math import log, log10, log2 ``` ### Statistics ```python from statistics import mean, median, variance, pvariance, pstdev ``` ### Random ```python from random import random, randint, choice, shuffle = random() = randint(from_inclusive, to_inclusive) = choice() shuffle() ``` ### Bin, Hex ```python = 0b # Or: 0x = int('0b', 0) # Or: int('0x', 0) = int('', 2) # Or: int('', 16) '0b' = bin() # Or: '0x' = hex() ``` ### Bitwise Operators ```python = & # And = | # Or = ^ # Xor (0 if both bits equal) = << n_bits # Shift left = >> n_bits # Shift right = ~ # Compliment (flips bits) ``` Combinatorics ------------- * **Every function returns an iterator.** * **If you want to print the iterator, you need to pass it to the list() function!** ```python from itertools import product, combinations, combinations_with_replacement, permutations ``` ```python >>> product([0, 1], repeat=3) [(0, 0, 0), (0, 0, 1), (0, 1, 0), (0, 1, 1), (1, 0, 0), (1, 0, 1), (1, 1, 0), (1, 1, 1)] ``` ```python >>> product('ab', '12') [('a', '1'), ('a', '2'), ('b', '1'), ('b', '2')] ``` ```python >>> combinations('abc', 2) [('a', 'b'), ('a', 'c'), ('b', 'c')] ``` ```python >>> combinations_with_replacement('abc', 2) [('a', 'a'), ('a', 'b'), ('a', 'c'), ('b', 'b'), ('b', 'c'), ('c', 'c')] ``` ```python >>> permutations('abc', 2) [('a', 'b'), ('a', 'c'), ('b', 'a'), ('b', 'c'), ('c', 'a'), ('c', 'b')] ``` Datetime -------- * **Module 'datetime' provides 'date' ``, 'time' ``, 'datetime' `
` and 'timedelta' `` classes. All are immutable and hashable.** * **Time and datetime can be 'aware' ``, meaning they have defined timezone, or 'naive' ``, meaning they don't.** * **If object is naive it is presumed to be in system's timezone.** ```python from datetime import date, time, datetime, timedelta from dateutil.tz import UTC, tzlocal, gettz ``` ### Constructors ```python = date(year, month, day) = time(hour=0, minute=0, second=0, microsecond=0, tzinfo=None, fold=0)
= datetime(year, month, day, hour=0, minute=0, second=0, ...) = timedelta(days=0, seconds=0, microseconds=0, milliseconds=0, minutes=0, hours=0, weeks=0) ``` * **Use `'.weekday()'` to get the day of the week (Mon == 0).** * **`'fold=1'` means second pass in case of time jumping back for one hour.** ### Now ```python = D/DT.today() # Current local date or naive datetime. = DT.utcnow() # Naive datetime from current UTC time. = DT.now() # Aware datetime from current tz time. ``` * **To extract time use `'.time()'`, `'.time()'` or `'.timetz()'`.** ### Timezone ```python = UTC # UTC timezone. London without DST. = tzlocal() # Local timezone. Also gettz(). = gettz('/') # Timezone from 'Continent/City_Name' str. ``` ```python =
.astimezone() # Datetime, converted to passed timezone. = .replace(tzinfo=) # Unconverted object with new timezone. ``` ### Encode ```python = D/T/DT.fromisoformat('') # Object from ISO string.
= DT.strptime(, '') # Datetime from str, according to format. = D/DT.fromordinal() # D/DTn from days since Christ, at midnight. = DT.fromtimestamp() # Local time DTn from seconds since Epoch. = DT.fromtimestamp(, ) # Aware datetime from seconds since Epoch. ``` * **ISO strings come in following forms: `'YYYY-MM-DD'`, `'HH:MM:SS.ffffff[±]'`, or both separated by `'T'`. Offset is formatted as: `'HH:MM'`.** * **On Unix systems Epoch is `'1970-01-01 00:00 UTC'`, `'1970-01-01 01:00 CET'`, ...** ### Decode ```python = .isoformat() # ISO string representation. = .strftime('') # Custom string representation. = .toordinal() # Days since Christ, ignoring time and tz. = .timestamp() # Seconds since Epoch from DTn in local time. = .timestamp() # Seconds since Epoch from DTa. ``` ### Format ```python >>> from datetime import datetime >>> dt = datetime.strptime('2015-05-14 23:39:00.00 +0200', '%Y-%m-%d %H:%M:%S.%f %z') >>> dt.strftime("%A, %dth of %B '%y, %I:%M%p %Z") "Thursday, 14th of May '15, 11:39PM UTC+02:00" ``` * **For abbreviated weekday and month use `'%a'` and `'%b'`.** * **When parsing, `'%z'` also accepts `'±HH:MM'`.** ### Arithmetics ```python = ± = ± = */ = / ``` Arguments --------- ### Inside Function Call ```python () # f(0, 0) () # f(x=0, y=0) (, ) # f(0, y=0) ``` ### Inside Function Definition ```python def f(): # def f(x, y): def f(): # def f(x=0, y=0): def f(, ): # def f(x, y=0): ``` Splat Operator -------------- ### Inside Function Call **Splat expands a collection into positional arguments, while splatty-splat expands a dictionary into keyword arguments.** ```python args = (1, 2) kwargs = {'x': 3, 'y': 4, 'z': 5} func(*args, **kwargs) ``` #### Is the same as: ```python func(1, 2, x=3, y=4, z=5) ``` ### Inside Function Definition **Splat combines zero or more positional arguments into a tuple, while splatty-splat combines zero or more keyword arguments into a dictionary.** ```python def add(*a): return sum(a) ``` ```python >>> add(1, 2, 3) 6 ``` #### Legal argument combinations: ```python def f(x, y, z): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) | f(1, 2, 3) def f(*, x, y, z): # f(x=1, y=2, z=3) def f(x, *, y, z): # f(x=1, y=2, z=3) | f(1, y=2, z=3) def f(x, y, *, z): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) ``` ```python def f(*args): # f(1, 2, 3) def f(x, *args): # f(1, 2, 3) def f(*args, z): # f(1, 2, z=3) def f(x, *args, z): # f(1, 2, z=3) ``` ```python def f(**kwargs): # f(x=1, y=2, z=3) def f(x, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) def f(*, x, **kwargs): # f(x=1, y=2, z=3) ``` ```python def f(*args, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) | f(1, 2, 3) def f(x, *args, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) | f(1, 2, 3) def f(*args, y, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) def f(x, *args, z, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) ``` ### Other Uses ```python = [* [, ...]] = {* [, ...]} = (*, [...]) = {** [, ...]} ``` ```python head, *body, tail = ``` Inline ------ ### Lambda ```python = lambda: = lambda , : ``` ### Comprehension ```python = [i+1 for i in range(10)] # [1, 2, ..., 10] = {i for i in range(10) if i > 5} # {6, 7, 8, 9} = (i+5 for i in range(10)) # (5, 6, ..., 14) = {i: i*2 for i in range(10)} # {0: 0, 1: 2, ..., 9: 18} ``` ```python out = [i+j for i in range(10) for j in range(10)] ``` #### Is the same as: ```python out = [] for i in range(10): for j in range(10): out.append(i+j) ``` ### Map, Filter, Reduce ```python from functools import reduce = map(lambda x: x + 1, range(10)) # (1, 2, ..., 10) = filter(lambda x: x > 5, range(10)) # (6, 7, 8, 9) = reduce(lambda out, x: out + x, range(10)) # 45 ``` ### Any, All ```python = any() # False if empty. = all(el[1] for el in ) # True if empty. ``` ### If - Else ```python if else ``` ```python >>> [a if a else 'zero' for a in (0, 1, 0, 3)] ['zero', 1, 'zero', 3] ``` ### Namedtuple, Enum, Dataclass ```python from collections import namedtuple Point = namedtuple('Point', 'x y') point = Point(0, 0) ``` ```python from enum import Enum Direction = Enum('Direction', 'n e s w') direction = Direction.n ``` ```python from dataclasses import make_dataclass Creature = make_dataclass('Creature', ['location', 'direction']) creature = Creature(Point(0, 0), Direction.n) ``` Closure ------- **We have a closure in Python when:** * **A nested function references a value of its enclosing function and then** * **the enclosing function returns the nested function.** ```python def get_multiplier(a): def out(b): return a * b return out ``` ```python >>> multiply_by_3 = get_multiplier(3) >>> multiply_by_3(10) 30 ``` * **If multiple nested functions within enclosing function reference the same value, that value gets shared.** * **To dynamically access function's first free variable use `'.__closure__[0].cell_contents'`.** ### Partial ```python from functools import partial = partial( [, , , ...]) ``` ```python >>> import operator as op >>> multiply_by_3 = partial(op.mul, 3) >>> multiply_by_3(10) 30 ``` * **Partial is also useful in cases when a function needs to be passed as an argument, because it enables us to set its arguments beforehand.** * **A few examples being `'defaultdict()'`, `'iter(, to_exclusive)'` and dataclass's `'field(default_factory=)'`.** ### Nonlocal **If variable is being assigned to anywhere in the scope, it is regarded as a local variable, unless it is declared as a 'global' or a 'nonlocal'.** ```python def get_counter(): i = 0 def out(): nonlocal i i += 1 return i return out ``` ```python >>> counter = get_counter() >>> counter(), counter(), counter() (1, 2, 3) ``` Decorator --------- **A decorator takes a function, adds some functionality and returns it.** ```python @decorator_name def function_that_gets_passed_to_decorator(): ... ``` ### Debugger Example **Decorator that prints function's name every time it gets called.** ```python from functools import wraps def debug(func): @wraps(func) def out(*args, **kwargs): print(func.__name__) return func(*args, **kwargs) return out @debug def add(x, y): return x + y ``` * **Wraps is a helper decorator that copies metadata of function add() to function out().** * **Without it `'add.__name__'` would return `'out'`.** ### LRU Cache **Decorator that caches function's return values. All function's arguments must be hashable.** ```python from functools import lru_cache @lru_cache(maxsize=None) def fib(n): return n if n < 2 else fib(n-2) + fib(n-1) ``` * **Recursion depth is limited to 1000 by default. To increase it use `'sys.setrecursionlimit()'`.** ### Parametrized Decorator **A decorator that accepts arguments and returns a normal decorator that accepts a function.** ```python from functools import wraps def debug(print_result=False): def decorator(func): @wraps(func) def out(*args, **kwargs): result = func(*args, **kwargs) print(func.__name__, result if print_result else '') return result return out return decorator @debug(print_result=True) def add(x, y): return x + y ``` Class ----- ```python class : def __init__(self, a): self.a = a def __repr__(self): class_name = self.__class__.__name__ return f'{class_name}({self.a!r})' def __str__(self): return str(self.a) @classmethod def get_class_name(cls): return cls.__name__ ``` * **Return value of repr() should be unambiguous and of str() readable.** * **If only repr() is defined, it will be also used for str().** #### Str() use cases: ```python print() print(f'{}') raise Exception() logging.debug() csv.writer().writerow([]) ``` #### Repr() use cases: ```python print([]) print(f'{!r}') >>> loguru.logger.exception() Z = dataclasses.make_dataclass('Z', ['a']); print(Z()) ``` ### Constructor Overloading ```python class : def __init__(self, a=None): self.a = a ``` ### Inheritance ```python class Person: def __init__(self, name, age): self.name = name self.age = age class Employee(Person): def __init__(self, name, age, staff_num): super().__init__(name, age) self.staff_num = staff_num ``` ### Multiple Inheritance ```python class A: pass class B: pass class C(A, B): pass ``` **MRO determines the order in which parent classes are traversed when searching for a method:** ```python >>> C.mro() [, , , ] ``` ### Property ```python class MyClass: @property def a(self): return self._a @a.setter def a(self, value): self._a = value ``` ```python >>> el = MyClass() >>> el.a = 123 >>> el.a 123 ``` ### Dataclass **Decorator that automatically generates init(), repr() and eq() special methods.** ```python from dataclasses import dataclass, field @dataclass(order=False, frozen=False) class : : : = : list/dict/set = field(default_factory=list/dict/set) ``` * **An object can be made sortable with `'order=True'` or immutable with `'frozen=True'`.** * **Function field() is needed because `': list = []'` would make a list that is shared among all instances.** * **Default_factory can be any callable.** ### Slots **Mechanism that restricts objects to attributes listed in 'slots' and significantly reduces their memory footprint.** ```python class MyClassWithSlots: __slots__ = ['a'] def __init__(self): self.a = 1 ``` ### Copy ```python from copy import copy, deepcopy = copy() = deepcopy() ``` Duck Types ---------- **A duck type is an implicit type that prescribes a set of special methods. Any object that has those methods defined is considered a member of that duck type.** ### Comparable * **If eq() method is not overridden, it returns `'id(self) == id(other)'`, which is the same as `'self is other'`.** * **That means all objects compare not equal by default.** * **Only left side object has eq() method called, unless it returns 'NotImplemented', in which case the right object is consulted.** ```python class MyComparable: def __init__(self, a): self.a = a def __eq__(self, other): if isinstance(other, type(self)): return self.a == other.a return NotImplemented ``` ### Hashable * **Hashable object needs both hash() and eq() methods and its hash value should never change.** * **Hashable objects that compare equal must have the same hash value, meaning default hash() that returns `'id(self)'` will not do.** * **That is why Python automatically makes classes unhashable if you only implement eq().** ```python class MyHashable: def __init__(self, a): self._a = copy.deepcopy(a) @property def a(self): return self._a def __eq__(self, other): if isinstance(other, type(self)): return self.a == other.a return NotImplemented def __hash__(self): return hash(self.a) ``` ### Sortable * **With 'total_ordering' decorator you only need to provide eq() and one of lt(), gt(), le() or ge() special methods.** ```python from functools import total_ordering @total_ordering class MySortable: def __init__(self, a): self.a = a def __eq__(self, other): if isinstance(other, type(self)): return self.a == other.a return NotImplemented def __lt__(self, other): if isinstance(other, type(self)): return self.a < other.a return NotImplemented ``` ### Iterator * **Next() should return next item or raise 'StopIteration'.** * **Iter() should return 'self'.** ```python class Counter: def __init__(self): self.i = 0 def __next__(self): self.i += 1 return self.i def __iter__(self): return self ``` ```python >>> counter = Counter() >>> next(counter), next(counter), next(counter) (1, 2, 3) ``` ### Callable ```python class Counter: def __init__(self): self.i = 0 def __call__(self): self.i += 1 return self.i ``` ```python >>> counter = Counter() >>> counter(), counter(), counter() (1, 2, 3) ``` ### Context Manager ```python class MyOpen(): def __init__(self, filename): self.filename = filename def __enter__(self): self.file = open(self.filename) return self.file def __exit__(self, *args): self.file.close() ``` ```python >>> with open('test.txt', 'w') as file: ... file.write('Hello World!') >>> with MyOpen('test.txt') as file: ... print(file.read()) Hello World! ``` #### List of existing context managers: ```python with open('', ...) as file: ... with wave.open('', ...) as wave_file: ... with memoryview() as view: ... db = sqlite3.connect(''); with db: db.execute('') lock = threading.RLock(); with lock: ... ``` Iterable Duck Types ------------------- ### Iterable * **Only required method is iter(). It should return an iterator of object's items.** * **Contains() automatically works on any object that has iter() defined.** ```python class MyIterable: def __init__(self, a): self.a = a def __iter__(self): for el in self.a: yield el ``` ```python >>> a = MyIterable([1, 2, 3]) >>> iter(a) >>> 1 in a True ``` ### Collection * **Only required methods are iter() and len().** * **This cheatsheet actually means `''` when it uses `''`.** * **I chose not to use the name 'iterable' because it sounds scarier and more vague than 'collection'.** ```python class MyCollection: def __init__(self, a): self.a = a def __iter__(self): return iter(self.a) def __contains__(self, el): return el in self.a def __len__(self): return len(self.a) ``` ### Sequence * **Only required methods are len() and getitem().** * **Getitem() should return an item at index or raise 'IndexError'.** * **Iter() and contains() automatically work on any object that has getitem() defined.** * **Reversed() automatically works on any object that has getitem() and len() defined.** ```python class MySequence: def __init__(self, a): self.a = a def __iter__(self): return iter(self.a) def __contains__(self, el): return el in self.a def __len__(self): return len(self.a) def __getitem__(self, i): return self.a[i] def __reversed__(self): return reversed(self.a) ``` ### Collections.abc.Sequence * **It's a richer interface than the basic sequence.** * **Extending it generates iter(), contains(), reversed(), index(), and count().** * **Unlike `'abc.Iterable'` and `'abc.Collection'`, it is not a duck type. That is why `'issubclass(MySequence, collections.abc.Sequence)'` would return 'False' even if 'MySequence' had all the methods defined.** ```python class MyAbcSequence(collections.abc.Sequence): def __init__(self, a): self.a = a def __len__(self): return len(self.a) def __getitem__(self, i): return self.a[i] ``` #### Table of required and available special methods: ```text +------------+----------+------------+----------+--------------+ | | Iterable | Collection | Sequence | abc.Sequence | +------------+----------+------------+----------+--------------+ | iter() | REQ | REQ | yes | yes | | contains() | yes | yes | yes | yes | | len() | | REQ | REQ | REQ | | getitem() | | | REQ | REQ | | reversed() | | | yes | yes | | index() | | | | yes | | count() | | | | yes | +------------+----------+------------+----------+--------------+ ``` * **Other useful ABCs that automatically generate missing methods are: MutableSequence, Set, MutableSet, Mapping and MutableMapping.** Enum ---- ```python from enum import Enum, auto class (Enum): = = , = auto() @classmethod def get_member_names(cls): return [a.name for a in cls.__members__.values()] ``` * **If there are no numeric values before auto(), it returns 1.** * **Otherwise it returns an increment of last numeric value.** ```python = . = [''] = () name = .name value = .value ``` ```python list_of_members = list() member_names = [a.name for a in ] member_values = [a.value for a in ] random_member = random.choice(list()) ``` ### Inline ```python Cutlery = Enum('Cutlery', ['fork', 'knife', 'spoon']) Cutlery = Enum('Cutlery', 'fork knife spoon') Cutlery = Enum('Cutlery', {'fork': 1, 'knife': 2, 'spoon': 3}) ``` #### Functions can not be values, so they must be wrapped: ```python from functools import partial LogicOp = Enum('LogicOp', {'AND': partial(lambda l, r: l and r), 'OR' : partial(lambda l, r: l or r)}) ``` * **Another solution in this particular case, is to use `'and_'` and `'or_'` functions from module [Operator](#operator).** Exceptions ---------- ### Basic Example ```python try: except : ``` ### Complex Example ```python try: except : except : else: finally: ``` ### Catching Exceptions ```python except : except as : except (, , ...): except (, , ...) as : ``` * **Also catches subclasses of the exception.** ### Raising Exceptions ```python raise raise () raise () raise (, , ...) ``` #### Useful built-in exceptions: ```python raise ValueError('Argument is of right type but inappropriate value!') raise TypeError('Argument is of wrong type!') raise RuntimeError('None of above!') ``` #### Re-raising caught exception: ```python except : raise ``` ### Common Built-in Exceptions ```text BaseException +-- SystemExit # Raised by the sys.exit() function. +-- KeyboardInterrupt # Raised when the user hits the interrupt key. +-- Exception # User-defined exceptions should be derived from this class. +-- StopIteration # Raised by next() when run on an empty iterator. +-- ArithmeticError # Base class for arithmetic errors. | +-- ZeroDivisionError # Raised when dividing by zero. +-- AttributeError # Raised when an attribute is missing. +-- EOFError # Raised by input() when it hits end-of-file condition. +-- LookupError # Raised when a look-up on sequence or dict fails. | +-- IndexError # Raised when a sequence index is out of range. | +-- KeyError # Raised when a dictionary key is not found. +-- NameError # Raised when a variable name is not found. +-- OSError # Failures such as “file not found” or “disk full”. | +-- FileNotFoundError # When a file or directory is requested but doesn't exist. +-- RuntimeError # Raised by errors that don't fall in other categories. | +-- RecursionError # Raised when the the maximum recursion depth is exceeded. +-- TypeError # Raised when an argument is of wrong type. +-- ValueError # When an argument is of right type but inappropriate value. +-- UnicodeError # Raised when encoding/decoding strings from/to bytes fails. ``` ### User-defined Exceptions ```python class MyError(Exception): pass class MyInputError(MyError): pass ``` Print ----- ```python print(, ..., sep=' ', end='\n', file=sys.stdout, flush=False) ``` * **Use `'file=sys.stderr'` for errors.** * **Use `'flush=True'` to forcibly flush the stream.** ### Pretty Print ```python >>> from pprint import pprint >>> pprint(dir()) ['__annotations__', '__builtins__', '__doc__', ...] ``` Input ----- * **Reads a line from user input or pipe if present.** * **Trailing newline gets stripped.** * **Prompt string is printed to the standard output before reading input.** ```python = input(prompt=None) ``` #### Prints lines until EOF: ```python while True: try: print(input()) except EOFError: break ``` Command Line Arguments ---------------------- ```python import sys script_name = sys.argv[0] arguments = sys.argv[1:] ``` ### Argparse ```python from argparse import ArgumentParser, FileType p = ArgumentParser(description=) p.add_argument('-', '--', action='store_true') # Flag p.add_argument('-', '--', type=) # Option p.add_argument('', type=, nargs=1) # Argument p.add_argument('', type=, nargs='+') # Arguments args = p.parse_args() value = args. ``` * **Use `'help='` for argument description.** * **Use `'type=FileType()'` for files.** Open ---- **Opens a file and returns a corresponding file object.** ```python = open('', mode='r', encoding=None, newline=None) ``` * **`'encoding=None'` means default encoding is used, which is platform dependent. Best practice is to use `'encoding="utf-8"'` whenever possible.** * **`'newline=None'` means all different end of line combinations are converted to '\n' on read, while on write all '\n' characters are converted to system's default line separator.** * **`'newline=""'` means no conversions take place, but lines are still broken by readline() on either '\n', '\r' or '\r\n'.** ### Modes * **`'r'` - Read (default).** * **`'w'` - Write (truncate).** * **`'x'` - Write or fail if the file already exists.** * **`'a'` - Append.** * **`'w+'` - Read and write (truncate).** * **`'r+'` - Read and write from the start.** * **`'a+'` - Read and write from the end.** * **`'t'` - Text mode (default).** * **`'b'` - Binary mode.** ### Exceptions * **`'FileNotFoundError'` can be risen when reading with `'r'` or `'r+'`.** * **`'FileExistsError'` can be risen when writing with `'x'`.** * **`'IsADirectoryError'` and `'PermissionError'` can be risen by any.** * **`'OSError'` is the parent class of all listed exceptions.** ### File ```python .seek(0) # Moves to the start of the file. .seek(offset) # Moves 'offset' chars/bytes from the start. .seek(0, 2) # Moves to the end of the file. .seek(±offset, ) # Anchor: 0 start, 1 current pos., 2 end. ``` ```python = .read(size=-1) # Reads 'size' chars/bytes or until EOF. = .readline() # Returns a line or empty string on EOF. = .readlines() # Returns a list of lines or empty list. = next() # Returns a line using buffer. Do not mix. ``` ```python .write() # Writes a string or bytes object. .writelines() # Writes a coll. of strings or bytes objects. .flush() # Flushes write buffer. ``` * **Methods do not add or strip trailing newlines, even writelines().** ### Read Text from File ```python def read_file(filename): with open(filename, encoding='utf-8') as file: return file.readlines() ``` ### Write Text to File ```python def write_to_file(filename, text): with open(filename, 'w', encoding='utf-8') as file: file.write(text) ``` Path ---- ```python from os import path, listdir from glob import glob ``` ```python = path.exists('') = path.isfile('') = path.isdir('') ``` ```python = listdir('') # List of filenames located at 'path'. = glob('') # Filenames matching the wildcard pattern. ``` ### Pathlib ```python from pathlib import Path ``` ```python cwd = Path() = Path('' [, '', , ...]) = / '' / '' ``` ```python = .exists() = .is_file() = .is_dir() ``` ```python = .iterdir() # Iterator of filenames located at path. = .glob('') # Filenames matching the wildcard pattern. ``` ```python = str() # Returns path as a string. = .parts # Returns all components as strings. = .resolve() # Returns absolute Path without symlinks. ``` ```python = .name # Final component. = .stem # Final component without extension. = .suffix # Final component's extension. = .parent # Path without final component. ``` Command Execution ----------------- ### Files and Directories * **Paths can be either strings or Path objects.** * **All exceptions are either 'OSError' or its subclasses.** ```python import os = os.getcwd() # Returns the current working directory. os.chdir() # Changes the current working directory. ``` ```python os.remove() # Deletes the file. os.rmdir() # Deletes empty directory. shutil.rmtree() # Deletes the entire directory tree. ``` ```python os.rename(from, to) # Renames the file or directory. os.replace(from, to) # Same, but overwrites 'to' if it exists. ``` ```python os.mkdir(, mode=0o777) # Creates a directory. = os.scandir(path='.') # Returns os.DirEntry objects located at path. ``` #### DirEntry: ```python = .name # Final component of the path. = .path # Path with final component. = Path() # Path object. ``` ```python = .is_file() = .is_dir() = .is_symlink() ``` ### Shell Commands ```python import os = os.popen('').read() ``` #### Using subprocess: ```python >>> import subprocess, shlex >>> a = subprocess.run(shlex.split('ls -a'), stdout=subprocess.PIPE) >>> a.stdout b'.\n..\nfile1.txt\nfile2.txt\n' >>> a.returncode 0 ``` CSV --- ```python import csv = csv.reader(, dialect='excel', delimiter=',') = next() # Returns a row as list of strings. ``` ```python = csv.writer(, dialect='excel', delimiter=',') .writerow() # Encodes objects using `str()`. .writerows() ``` * **File must be opened with `'newline=""'` argument, or newlines embedded inside quoted fields will not be interpreted correctly!** ### Parameters * **`'dialect'` - Master parameter that sets the default values.** * **`'delimiter'` - A one-character string used to separate fields.** * **`'quotechar'` - Character for quoting fields that contain special characters.** * **`'doublequote'` - Whether quotechars inside fields get doubled or escaped.** * **`'skipinitialspace'` - Whether whitespace after delimiter gets stripped.** * **`'lineterminator'` - How does writer terminate lines.** * **`'quoting'` - Controls the amount of quoting: 0 - as necessary, 1 - all.** * **`'escapechar'` - Character for escaping quotechar if doublequote is false.** ### Dialects ```text +------------------+-----------+-----------+--------------+ | | excel | excel_tab | unix_dialect | +------------------+-----------+-----------+--------------+ | delimiter | ',' | '\t' | ',' | | quotechar | '"' | '"' | '"' | | doublequote | True | True | True | | skipinitialspace | False | False | False | | lineterminator | '\r\n' | '\r\n' | '\n' | | quoting | 0 | 0 | 1 | | escapechar | None | None | None | +------------------+-----------+-----------+--------------+ ``` ### Read Rows from CSV File ```python def read_csv_file(filename): with open(filename, encoding='utf-8', newline='') as file: return csv.reader(file) ``` ### Write Rows to CSV File ```python def write_to_csv_file(filename, rows): with open(filename, 'w', encoding='utf-8', newline='') as file: writer = csv.writer(file) writer.writerows(rows) ``` JSON ---- ```python import json = json.dumps(, ensure_ascii=True, indent=None) = json.loads() ``` ### Read Object from JSON File ```python def read_json_file(filename): with open(filename, encoding='utf-8') as file: return json.load(file) ``` ### Write Object to JSON File ```python def write_to_json_file(filename, an_object): with open(filename, 'w', encoding='utf-8') as file: json.dump(an_object, file, ensure_ascii=False, indent=2) ``` Pickle ------ ```python import pickle = pickle.dumps() = pickle.loads() ``` ### Read Object from File ```python def read_pickle_file(filename): with open(filename, 'rb') as file: return pickle.load(file) ``` ### Write Object to File ```python def write_to_pickle_file(filename, an_object): with open(filename, 'wb') as file: pickle.dump(an_object, file) ``` SQLite ------ **Server-less database engine that stores each database into separate file.** ```python import sqlite3 db = sqlite3.connect('') # Also ':memory:'. ... db.close() ``` * **New database will be created if path doesn't exist.** ### Read ```python cursor = db.execute('') if cursor: = cursor.fetchone() # First row. = cursor.fetchall() # Remaining rows. ``` * **Returned values can be of type str, int, float, bytes or None.** ### Write ```python db.execute('') db.commit() ``` ### Placeholders ```python db.execute('', ) # Replaces '?'s in query with values. db.execute('', ) # Replaces ':'s with values. db.executemany('', ) # Runs execute() many times. ``` * **Passed values can be of type str, int, float, bytes, None, bool, datetime.date or datetime.datetme.** ### MySQL **Has a very similar interface, with differences listed below.** ```python # $ pip3 install mysql-connector from mysql import connector db = connector.connect(host=, user=, password=, database=) cursor = db.cursor() cursor.execute('') # Connector doesn't have execute method. cursor.execute('', ) # Replaces '%s's in query with values. cursor.execute('', ) # Replaces '%()s's with values. ``` Bytes ----- **Bytes object is an immutable sequence of single bytes. Mutable version is called 'bytearray'.** ```python = b'' # Only accepts ASCII characters and \x00 - \xff. = [] # Returns int in range from 0 to 255. = [] # Returns bytes even if it has only one element. = .join() # Joins elements using bytes object as separator. ``` ### Encode ```python = .encode('utf-8') # Or: bytes(, 'utf-8') = bytes() # Ints must be in range from 0 to 255. = .to_bytes(, byteorder='big|little', signed=False) = bytes.fromhex('') ``` ### Decode ```python = .decode('utf-8') # Or: str(, 'utf-8') = list() # Returns ints in range from 0 to 255. = int.from_bytes(, byteorder='big|little', signed=False) '' = .hex() ``` ### Read Bytes from File ```python def read_bytes(filename): with open(filename, 'rb') as file: return file.read() ``` ### Write Bytes to File ```python def write_bytes(filename, bytes_obj): with open(filename, 'wb') as file: file.write(bytes_obj) ``` Struct ------ * **Module that performs conversions between a sequence of numbers and a C struct, represented as a Python bytes object.** * **Machine’s native type sizes and byte order are used by default.** ```python from struct import pack, unpack, iter_unpack, calcsize = pack('', [, , ...]) = unpack('', ) = iter_unpack('', ) ``` ### Example ```python >>> pack('>hhl', 1, 2, 3) b'\x00\x01\x00\x02\x00\x00\x00\x03' >>> unpack('>hhl', b'\x00\x01\x00\x02\x00\x00\x00\x03') (1, 2, 3) >>> calcsize('>hhl') 8 ``` ### Format #### For standard sizes start format string with: * **`'='` - native byte order** * **`'<'` - little-endian** * **`'>'` - big-endian** #### Integer types. Use capital letter for unsigned type. Standard sizes are in brackets: * **`'x'` - pad byte** * **`'b'` - char (1)** * **`'h'` - short (2)** * **`'i'` - int (4)** * **`'l'` - long (4)** * **`'q'` - long long (8)** #### Floating point types: * **`'f'` - float (4)** * **`'d'` - double (8)** Array ----- **List that can only hold numbers of predefined type. Available types and their sizes in bytes are listed above.** ```python from array import array = array('' [, ]) ``` Memory View ----------- **Used for accessing the internal data of an object that supports the buffer protocol.** ```python = memoryview( / / ) .release() ``` Deque ----- **A thread-safe list with efficient appends and pops from either side. Pronounced "deck".** ```python from collections import deque = deque(, maxlen=None) ``` ```python .appendleft() = .popleft() .extendleft() # Collection gets reversed. .rotate(n=1) # Rotates elements to the right. ``` ```python >>> a = deque([1, 2, 3], maxlen=3) >>> a.append(4) [2, 3, 4] >>> a.appendleft(5) [5, 2, 3] >>> a.insert(1, 6) IndexError: deque already at its maximum size ``` Threading --------- ```python from threading import Thread, RLock ``` ### Thread ```python thread = Thread(target=, args=(, )) thread.start() ... thread.join() ``` ### Lock ```python lock = RLock() lock.acquire() ... lock.release() ``` #### Or: ```python lock = RLock() with lock: ... ``` Introspection ------------- **Inspecting code at runtime.** ### Variables ```python = dir() # Names of variables in current scope. = locals() # Dict of local variables. Also vars(). = globals() # Dict of global variables. ``` ### Attributes ```python = vars() = hasattr(, '') value = getattr(, '') setattr(, '', value) ``` ### Parameters ```python from inspect import signature = signature() no_of_params = len(.parameters) param_names = list(.parameters.keys()) ``` Metaprograming -------------- **Code that generates code.** ### Type **Type is the root class. If only passed an object it returns its type (class). Otherwise it creates a new class.** ```python = type(, , ) ``` ```python >>> Z = type('Z', (), {'a': 'abcde', 'b': 12345}) >>> z = Z() ``` ### Meta Class **Class that creates class.** ```python def my_meta_class(name, parents, attrs): attrs['a'] = 'abcde' return type(name, parents, attrs) ``` #### Or: ```python class MyMetaClass(type): def __new__(cls, name, parents, attrs): attrs['a'] = 'abcde' return type.__new__(cls, name, parents, attrs) ``` * **New() is a class method that gets called before init(). If it returns an instance of its class, then that instance gets passed to init() as a 'self' argument.** * **It receives the same arguments as init(), except for the first one that specifies the desired class of returned instance (**`'MyMetaClass'` **in our case).** * **New() can also be called directly, usually from a new() method of a child class (**`def __new__(cls): return super().__new__(cls)`**), in which case init() is not called.** ### Metaclass Attribute **Right before a class is created it checks if it has metaclass defined. If not, it recursively checks if any of his parents has it defined and eventually comes to type().** ```python class MyClass(metaclass=MyMetaClass): b = 12345 ``` ```python >>> MyClass.a, MyClass.b ('abcde', 12345) ``` ### Type Diagram ```python type(MyClass) == MyMetaClass # MyClass is an instance of MyMetaClass. type(MyMetaClass) == type # MyMetaClass is an instance of type. ``` ```text +---------+-------------+ | Classes | Metaclasses | +---------+-------------| | MyClass > MyMetaClass | | | v | | object ---> type <+ | | | ^ +---+ | | str -------+ | +---------+-------------+ ``` ### Inheritance Diagram ```python MyClass.__base__ == object # MyClass is a subclass of object. MyMetaClass.__base__ == type # MyMetaClass is a subclass of type. ``` ```text +---------+-------------+ | Classes | Metaclasses | +---------+-------------| | MyClass | MyMetaClass | | v | v | | object <--- type | | ^ | | | str | | +---------+-------------+ ``` Operator -------- ```python from operator import add, sub, mul, truediv, floordiv, mod, pow, neg, abs from operator import eq, ne, lt, le, gt, ge from operator import and_, or_, not_ from operator import itemgetter, attrgetter, methodcaller ``` ```python import operator as op sorted_by_second = sorted(, key=op.itemgetter(1)) sorted_by_both = sorted(, key=op.itemgetter(1, 0)) product_of_elems = functools.reduce(op.mul, ) LogicOp = enum.Enum('LogicOp', {'AND': op.and_, 'OR' : op.or_}) last_el = op.methodcaller('pop')() ``` Eval ---- ```python >>> from ast import literal_eval >>> literal_eval('1 + 2') 3 >>> literal_eval('[1, 2, 3]') [1, 2, 3] >>> literal_eval('abs(1)') ValueError: malformed node or string ``` Coroutine --------- * **Similar to generator, but generator pulls data through the pipe with iteration, while coroutine pushes data into the pipeline with send().** * **Coroutines provide more powerful data routing possibilities than iterators.** * **If you build a collection of simple data processing components, you can glue them together into complex arrangements of pipes, branches, merging, etc.** ### Helper Decorator * **All coroutines must be "primed" by first calling next().** * **Remembering to call next() is easy to forget.** * **Solved by wrapping coroutines with a decorator:** ```python def coroutine(func): def out(*args, **kwargs): cr = func(*args, **kwargs) next(cr) return cr return out ``` ### Pipeline Example ```python def reader(target): for i in range(10): target.send(i) target.close() @coroutine def adder(target): while True: value = (yield) target.send(value + 100) @coroutine def printer(): while True: value = (yield) print(value) reader(adder(printer())) # 100, 101, ..., 109 ```

Libraries ========= Progress Bar ------------ ```python # $ pip3 install tqdm from tqdm import tqdm from time import sleep for i in tqdm([1, 2, 3]): sleep(0.2) for i in tqdm(range(100)): sleep(0.02) ``` Plot ---- ```python # $ pip3 install matplotlib from matplotlib import pyplot pyplot.plot( [, , ...]) # Or: hist(). pyplot.savefig() pyplot.show() pyplot.clf() # Clears figure. ``` Table ----- #### Prints a CSV file as an ASCII table: ```python # $ pip3 install tabulate from tabulate import tabulate import csv with open(, encoding='utf-8', newline='') as file: lines = csv.reader(file) headers = [header.title() for header in next(lines)] table = tabulate(lines, headers) print(table) ``` Curses ------ ```python from curses import wrapper, ascii def main(): wrapper(draw) def draw(screen): screen.clear() screen.addstr(0, 0, 'Press ESC to quit.') while screen.getch() != ascii.ESC: pass def get_border(screen): from collections import namedtuple P = namedtuple('P', 'y x') height, width = screen.getmaxyx() return P(height-1, width-1) if __name__ == '__main__': main() ``` Logging ------- ```python # $ pip3 install loguru from loguru import logger ``` ```python logger.add('debug_{time}.log', colorize=True) # Connects a log file. logger.add('error_{time}.log', level='ERROR') # Another file for errors or higher. logger.('A logging message.') ``` * **Levels: `'debug'`, `'info'`, `'success'`, `'warning'`, `'error'`, `'critical'`.** ### Exceptions **Error description, stack trace and values of variables are appended automatically.** ```python try: ... except : logger.exception('An error happened.') ``` ### Rotation **Argument that sets a condition when a new log file is created.** ```python rotation=||| ``` * **`''` - Max file size in bytes.** * **`''` - Max age of a file.** * **`'