Comprehensive Python Cheatsheet =============================== [Download text file](https://raw.githubusercontent.com/gto76/python-cheatsheet/master/README.md), [PDF](https://gto76.github.io/python-cheatsheet/web/python-cheatsheet-d3a72f9.pdf), [Fork me on GitHub](https://github.com/gto76/python-cheatsheet) or [Check out FAQ](https://github.com/gto76/python-cheatsheet/wiki/Frequently-Asked-Questions). ![Monty Python](web/image_888.jpeg) Contents -------- **   ** **1. Collections:** ** ** **[`List`](#list)**__,__ **[`Dictionary`](#dictionary)**__,__ **[`Set`](#set)**__,__ **[`Tuple`](#tuple)**__,__ **[`Range`](#range)**__,__ **[`Enumerate`](#enumerate)**__,__ **[`Iterator`](#iterator)**__,__ **[`Generator`](#generator)**__.__ **   ** **2. Types:** **          ** **[`Type`](#type)**__,__ **[`String`](#string)**__,__ **[`Regular_Exp`](#regex)**__,__ **[`Format`](#format)**__,__ **[`Numbers`](#numbers)**__,__ **[`Combinatorics`](#combinatorics)**__,__ **[`Datetime`](#datetime)**__.__ **   ** **3. Syntax:** **         ** **[`Args`](#arguments)**__,__ **[`Inline`](#inline)**__,__ **[`Closure`](#closure)**__,__ **[`Decorator`](#decorator)**__,__ **[`Class`](#class)**__,__ **[`Duck_Types`](#duck-types)**__,__ **[`Enum`](#enum)**__,__ **[`Exceptions`](#exceptions)**__.__ **   ** **4. System:** **        ** **[`Print`](#print)**__,__ **[`Input`](#input)**__,__ **[`Command_Line_Arguments`](#command-line-arguments)**__,__ **[`Open`](#open)**__,__ **[`Path`](#path)**__,__ **[`Command_Execution`](#command-execution)**__.__ **   ** **5. Data:** **             ** **[`CSV`](#csv)**__,__ **[`SQLite`](#sqlite)**__,__ **[`JSON`](#json)**__,__ **[`Pickle`](#pickle)**__,__ **[`Bytes`](#bytes)**__,__ **[`Struct`](#struct)**__,__ **[`Array`](#array)**__,__ **[`MemoryView`](#memory-view)**__,__ **[`Deque`](#deque)**__.__ **   ** **6. Advanced:** **   ** **[`Threading`](#threading)**__,__ **[`Operator`](#operator)**__,__ **[`Introspection`](#introspection)**__,__ **[`Metaprograming`](#metaprograming)**__,__ **[`Eval`](#eval)**__,__ **[`Coroutine`](#coroutine)**__.__ **   ** **7. Libraries:** **      ** **[`Progress_Bar`](#progress-bar)**__,__ **[`Plot`](#plot)**__,__ **[`Table`](#table)**__,__ **[`Curses`](#curses)**__,__ **[`Logging`](#logging)**__,__ **[`Scraping`](#scraping)**__,__ **[`Web`](#web)**__,__ **[`Profile`](#profiling)**__,__ **                                 ** **[`NumPy`](#numpy)**__,__ **[`Image`](#image)**__,__ **[`Animation`](#animation)**__,__ **[`Audio`](#audio)**__,__ **[`Synthesizer`](#synthesizer)**__.__ Main ---- ```python if __name__ == '__main__': # Runs main() if file wasn't imported. main() ``` List ---- ```python = [from_inclusive : to_exclusive : ±step_size] ``` ```python .append() # Or: += [] .extend() # Or: += ``` ```python .sort() .reverse() = sorted() = reversed() ``` ```python sum_of_elements = sum() elementwise_sum = [sum(pair) for pair in zip(list_a, list_b)] sorted_by_second = sorted(, key=lambda el: el[1]) sorted_by_both = sorted(, key=lambda el: (el[1], el[0])) flatter_list = list(itertools.chain.from_iterable()) product_of_elems = functools.reduce(lambda out, x: out * x, ) list_of_chars = list() ``` ```python = .count() # Returns number of occurrences. Also works on strings. index = .index() # Returns index of first occurrence or raises ValueError. .insert(index, ) # Inserts item at index and moves the rest to the right. = .pop([index]) # Removes and returns item at index or from the end. .remove() # Removes first occurrence of item or raises ValueError. .clear() # Removes all items. Also works on dictionary and set. ``` Dictionary ---------- ```python = .keys() # Coll. of keys that reflects changes. = .values() # Coll. of values that reflects changes. = .items() # Coll. of key-value tuples. ``` ```python value = .get(key, default=None) # Returns default if key is missing. value = .setdefault(key, default=None) # Returns and writes default if key is missing. = collections.defaultdict() # Creates a dict with default value of type. = collections.defaultdict(lambda: 1) # Creates a dict with default value 1. ``` ```python .update() = dict() # Creates a dict from coll. of key-value pairs. = dict(zip(keys, values)) # Creates a dict from two collections. = dict.fromkeys(keys [, value]) # Creates a dict from collection of keys. ``` ```python value = .pop(key) # Removes item or raises KeyError. {k: v for k, v in .items() if k in keys} # Filters dictionary by keys. ``` ### Counter ```python >>> from collections import Counter >>> colors = ['blue', 'red', 'blue', 'red', 'blue'] >>> counter = Counter(colors) >>> counter['yellow'] += 1 Counter({'blue': 3, 'red': 2, 'yellow': 1}) >>> counter.most_common()[0] ('blue', 3) ``` Set --- ```python = set() ``` ```python .add() # Or: |= {} .update() # Or: |= ``` ```python = .union() # Or: | = .intersection() # Or: & = .difference() # Or: - = .symmetric_difference() # Or: ^ = .issubset() # Or: <= = .issuperset() # Or: >= ``` ```python = .pop() # Raises KeyError if empty. .remove() # Raises KeyError if missing. .discard() # Doesn't raise an error. ``` ### Frozen Set * **Is immutable and hashable.** * **That means it can be used as a key in a dictionary or as an element in a set.** ```python = frozenset() ``` Tuple ----- **Tuple is an immutable and hashable list.** ```python = () = (, ) = (, [, ...]) ``` ### Named Tuple **Tuple's subclass with named elements.** ```python >>> from collections import namedtuple >>> Point = namedtuple('Point', 'x y') >>> p = Point(1, y=2) Point(x=1, y=2) >>> p[0] 1 >>> p.x 1 >>> getattr(p, 'y') 2 >>> p._fields # Or: Point._fields ('x', 'y') ``` Range ----- ```python = range(to_exclusive) = range(from_inclusive, to_exclusive) = range(from_inclusive, to_exclusive, ±step_size) ``` ```python from_inclusive = .start to_exclusive = .stop ``` Enumerate --------- ```python for i, el in enumerate( [, i_start]): ... ``` Iterator -------- ```python = iter() # `iter()` returns unmodified iterator. = iter(, to_exclusive) # Sequence of return values until 'to_exclusive'. = next( [, default]) # Raises StopIteration or returns 'default' on end. ``` ### Itertools ```python from itertools import count, repeat, cycle, chain, islice ``` ```python = count(start=0, step=1) # Returns incremented value endlessly. = repeat( [, times]) # Returns element endlessly or 'times' times. = cycle() # Repeats the sequence indefinitely. ``` ```python = chain(, [, ...]) # Empties collections in order. = chain.from_iterable() # Empties collections inside a collection in order. ``` ```python = islice(, to_exclusive) = islice(, from_inclusive, to_exclusive) = islice(, from_inclusive, to_exclusive, +step_size) ``` Generator --------- * **Any function that contains a yield statement returns a generator.** * **Generators and iterators are interchangeable.** ```python def count(start, step): while True: yield start start += step ``` ```python >>> counter = count(10, 2) >>> next(counter), next(counter), next(counter) (10, 12, 14) ``` Type ---- * **Everything is an object.** * **Every object has a type.** * **Type and class are synonymous.** ```python = type() # Or: .__class__ = isinstance(, ) # Or: issubclass(type(), ) ``` ```python >>> type('a'), 'a'.__class__, str (, , ) ``` #### Some types do not have built-in names, so they must be imported: ```python from types import FunctionType, MethodType, LambdaType, GeneratorType ``` ### ABC **An abstract base class introduces virtual subclasses, that don’t inherit from it but are still recognized by isinstance() and issubclass().** ```python >>> from collections.abc import Sequence, Collection, Iterable >>> isinstance([1, 2, 3], Iterable) True ``` ```text +------------------+----------+------------+----------+ | | Sequence | Collection | Iterable | +------------------+----------+------------+----------+ | list, range, str | yes | yes | yes | | dict, set | | yes | yes | | iter | | | yes | +------------------+----------+------------+----------+ ``` ```python >>> from numbers import Integral, Rational, Real, Complex, Number >>> isinstance(123, Number) True ``` ```text +--------------------+----------+----------+--------+---------+--------+ | | Integral | Rational | Real | Complex | Number | +--------------------+----------+----------+--------+---------+--------+ | int | yes | yes | yes | yes | yes | | fractions.Fraction | | yes | yes | yes | yes | | float | | | yes | yes | yes | | complex | | | | yes | yes | | decimal.Decimal | | | | | yes | +--------------------+----------+----------+--------+---------+--------+ ``` String ------ ```python = .strip() # Strips all whitespace characters from both ends. = .strip('') # Strips all passed characters from both ends. ``` ```python = .split() # Splits on one or more whitespace characters. = .split(sep=None, maxsplit=-1) # Splits on 'sep' str at most 'maxsplit' times. = .splitlines(keepends=False) # Splits on line breaks. Keeps them if 'keepends'. = .join() # Joins elements using string as separator. ``` ```python = in # Checks if string contains a substring. = .startswith() # Pass tuple of strings for multiple options. = .endswith() # Pass tuple of strings for multiple options. = .find() # Returns start index of first match or -1. = .index() # Same but raises ValueError if missing. ``` ```python = .replace(old, new [, count]) # Replaces 'old' with 'new' at most 'count' times. = .isnumeric() # True if str contains only numeric characters. = textwrap.wrap(, width) # Nicely breaks string into lines. ``` * **Also: `'lstrip()'`, `'rstrip()'`.** * **Also: `'lower()'`, `'upper()'`, `'capitalize()'` and `'title()'`.** ### Char ```python = chr() # Converts int to unicode char. = ord() # Converts unicode char to int. ``` ```python >>> ord('0'), ord('9') (48, 57) >>> ord('A'), ord('Z') (65, 90) >>> ord('a'), ord('z') (97, 122) ``` Regex ----- ```python import re = re.sub(, new, text, count=0) # Substitutes all occurrences. = re.findall(, text) # Returns all occurrences. = re.split(, text, maxsplit=0) # Use brackets in regex to keep the matches. = re.search(, text) # Searches for first occurrence of pattern. = re.match(, text) # Searches only at the beginning of the text. = re.finditer(, text) # Returns all occurrences as match objects. ``` * **Search() and match() return None if they can't find a match.** * **Argument `'flags=re.IGNORECASE'` can be used with all functions.** * **Argument `'flags=re.MULTILINE'` makes `'^'` and `'$'` match the start/end of each line.** * **Argument `'flags=re.DOTALL'` makes dot also accept newline.** * **Use `r'\1'` or `'\\1'` for backreference.** * **Add `'?'` after an operator to make it non-greedy.** ### Match Object ```python = .group() # Whole match. Also group(0). = .group(1) # Part in first bracket. = .groups() # All bracketed parts. = .start() # Start index of a match. = .end() # Exclusive end index of a match. ``` ### Special Sequences * **By default digits, whitespaces and alphanumerics from all alphabets are matched, unless `'flags=re.ASCII'` argument is used.** * **Use capital letters for negation.** ```python '\d' == '[0-9]' # Digit '\s' == '[ \t\n\r\f\v]' # Whitespace '\w' == '[a-zA-Z0-9_]' # Alphanumeric ``` Format ------ ```python = f'{}, {}' = '{}, {}'.format(, ) ``` ### Attributes ```python >>> from collections import namedtuple >>> Person = namedtuple('Person', 'name height') >>> person = Person('Jean-Luc', 187) >>> f'{person.height}' '187' >>> '{p.height}'.format(p=person) '187' ``` ### General Options ```python {:<10} # ' ' {:^10} # ' ' {:>10} # ' ' ``` ```python {:.<10} # '......' {:<0} # '' ``` ### Strings **`'!r'` calls object's repr() method, instead of str(), to get a string.** ```python {'abcde'!r:<10} # "'abcde' " {'abcde':.3} # 'abc' {'abcde':10.3} # 'abc ' ``` ### Numbers ```python { 123456:10,} # ' 123,456' { 123456:10_} # ' 123_456' { 123456:+10} # ' +123456' {-123456:=10} # '- 123456' { 123456: } # ' 123456' {-123456: } # '-123456' ``` ### Floats ```python {1.23456:10.3} # ' 1.23' {1.23456:10.3f} # ' 1.235' {1.23456:10.3e} # ' 1.235e+00' {1.23456:10.3%} # ' 123.456%' ``` #### Comparison of float presentation types: ```text +----------------+----------------+---------------+----------------+-----------------+ | | {} | {:f} | {:e} | {:%} | +----------------+----------------+---------------+----------------+-----------------+ | 0.000056789 | '5.6789e-05' | '0.000057' | '5.678900e-05' | '0.005679%' | | 0.00056789 | '0.00056789' | '0.000568' | '5.678900e-04' | '0.056789%' | | 0.0056789 | '0.0056789' | '0.005679' | '5.678900e-03' | '0.567890%' | | 0.056789 | '0.056789' | '0.056789' | '5.678900e-02' | '5.678900%' | | 0.56789 | '0.56789' | '0.567890' | '5.678900e-01' | '56.789000%' | | 5.6789 | '5.6789' | '5.678900' | '5.678900e+00' | '567.890000%' | | 56.789 | '56.789' | '56.789000' | '5.678900e+01' | '5678.900000%' | | 567.89 | '567.89' | '567.890000' | '5.678900e+02' | '56789.000000%' | +----------------+----------------+---------------+----------------+-----------------+ ``` ```text +----------------+----------------+---------------+----------------+-----------------+ | | {:.2} | {:.2f} | {:.2e} | {:.2%} | +----------------+----------------+---------------+----------------+-----------------+ | 0.000056789 | '5.7e-05' | '0.00' | '5.68e-05' | '0.01%' | | 0.00056789 | '0.00057' | '0.00' | '5.68e-04' | '0.06%' | | 0.0056789 | '0.0057' | '0.01' | '5.68e-03' | '0.57%' | | 0.056789 | '0.057' | '0.06' | '5.68e-02' | '5.68%' | | 0.56789 | '0.57' | '0.57' | '5.68e-01' | '56.79%' | | 5.6789 | '5.7' | '5.68' | '5.68e+00' | '567.89%' | | 56.789 | '5.7e+01' | '56.79' | '5.68e+01' | '5678.90%' | | 567.89 | '5.7e+02' | '567.89' | '5.68e+02' | '56789.00%' | +----------------+----------------+---------------+----------------+-----------------+ ``` ### Ints ```python {90:c} # 'Z' {90:X} # '5A' {90:b} # '1011010' ``` Numbers ------- ### Types ```python = int() # Or: math.floor() = float() = complex(real=0, imag=0) # Or: + j = fractions.Fraction(numerator=0, denominator=1) = decimal.Decimal() ``` * **`'int()'` and `'float()'` raise ValueError on malformed strings.** * **Decimal numbers can be represented exactly, unlike floats where `'1.1 + 2.2 != 3.3'`.** * **Their precision can be adjusted with `'decimal.getcontext().prec = '`.** ### Basic Functions ```python = pow(, ) # Or: ** = abs() = round() = round(, ±ndigits) # `round(126, -1) == 130` ``` ### Math ```python from math import e, pi, inf, nan from math import cos, acos, sin, asin, tan, atan, degrees, radians from math import log, log10, log2 ``` ### Statistics ```python from statistics import mean, median, variance, pvariance, pstdev ``` ### Random ```python from random import random, randint, choice, shuffle = random() = randint(from_inclusive, to_inclusive) = choice() shuffle() ``` ### Bin, Hex ```python = 0b # Or: 0x = int('', 2) # Or: int('', 16) = int('0b', 0) # Or: int('0x', 0) '0b' = bin() # Or: '0x' = hex() ``` ### Bitwise Operators ```python = & # And = | # Or = ^ # Xor (0 if both bits equal) = << n_bits # Shift left = >> n_bits # Shift right = ~ # Compliment (flips bits) ``` Combinatorics ------------- * **Every function returns an iterator.** * **If you want to print the iterator, you need to pass it to the list() function!** ```python from itertools import product, combinations, combinations_with_replacement, permutations ``` ```python >>> product([0, 1], repeat=3) [(0, 0, 0), (0, 0, 1), (0, 1, 0), (0, 1, 1), (1, 0, 0), (1, 0, 1), (1, 1, 0), (1, 1, 1)] ``` ```python >>> product('ab', '12') [('a', '1'), ('a', '2'), ('b', '1'), ('b', '2')] ``` ```python >>> combinations('abc', 2) [('a', 'b'), ('a', 'c'), ('b', 'c')] ``` ```python >>> combinations_with_replacement('abc', 2) [('a', 'a'), ('a', 'b'), ('a', 'c'), ('b', 'b'), ('b', 'c'), ('c', 'c')] ``` ```python >>> permutations('abc', 2) [('a', 'b'), ('a', 'c'), ('b', 'a'), ('b', 'c'), ('c', 'a'), ('c', 'b')] ``` Datetime -------- * **Module 'datetime' provides 'date' ``, 'time' ``, 'datetime' `
` and 'timedelta' `` classes. All are immutable and hashable.** * **Time and datetime can be 'aware' ``, meaning they have defined timezone, or 'naive' ``, meaning they don't.** * **If object is naive it is presumed to be in the system's timezone.** ```python from datetime import date, time, datetime, timedelta from dateutil.tz import UTC, tzlocal, gettz ``` ### Constructors ```python = date(year, month, day) = time(hour=0, minute=0, second=0, microsecond=0, tzinfo=None, fold=0)
= datetime(year, month, day, hour=0, minute=0, second=0, ...) = timedelta(days=0, seconds=0, microseconds=0, milliseconds=0, minutes=0, hours=0, weeks=0) ``` * **Use `'.weekday()'` to get the day of the week (Mon == 0).** * **`'fold=1'` means second pass in case of time jumping back for one hour.** ### Now ```python = D/DT.today() # Current local date or naive datetime. = DT.utcnow() # Naive datetime from current UTC time. = DT.now() # Aware datetime from current tz time. ``` * **To extract time use `'.time()'`, `'.time()'` or `'.timetz()'`.** ### Timezone ```python = UTC # UTC timezone. London without DST. = tzlocal() # Local timezone. Also gettz(). = gettz('/') # 'Continent/City_Name' timezone or None. ``` ```python =
.astimezone() # Datetime, converted to passed timezone. = .replace(tzinfo=) # Unconverted object with new timezone. ``` ### Encode ```python = D/T/DT.fromisoformat('') # Object from ISO string. Raises ValueError.
= DT.strptime(, '') # Datetime from str, according to format. = D/DT.fromordinal() # D/DTn from days since Christ, at midnight. = DT.fromtimestamp() # Local time DTn from seconds since Epoch. = DT.fromtimestamp(, ) # Aware datetime from seconds since Epoch. ``` * **ISO strings come in following forms: `'YYYY-MM-DD'`, `'HH:MM:SS.ffffff[±]'`, or both separated by a space or a `'T'`. Offset is formatted as: `'HH:MM'`.** * **On Unix systems Epoch is `'1970-01-01 00:00 UTC'`, `'1970-01-01 01:00 CET'`, ...** ### Decode ```python = .isoformat() # ISO string representation. = .strftime('') # Custom string representation. = .toordinal() # Days since Christ, ignoring time and tz. = .timestamp() # Seconds since Epoch from DTn in local time. = .timestamp() # Seconds since Epoch from DTa. ``` ### Format ```python >>> from datetime import datetime >>> dt = datetime.strptime('2015-05-14 23:39:00.00 +0200', '%Y-%m-%d %H:%M:%S.%f %z') >>> dt.strftime("%A, %dth of %B '%y, %I:%M%p %Z") "Thursday, 14th of May '15, 11:39PM UTC+02:00" ``` * **When parsing, `'%z'` also accepts `'±HH:MM'`.** * **For abbreviated weekday and month use `'%a'` and `'%b'`.** ### Arithmetics ```python = - = ± = ± = */ ``` Arguments --------- ### Inside Function Call ```python () # f(0, 0) () # f(x=0, y=0) (, ) # f(0, y=0) ``` ### Inside Function Definition ```python def f(): # def f(x, y): def f(): # def f(x=0, y=0): def f(, ): # def f(x, y=0): ``` Splat Operator -------------- ### Inside Function Call **Splat expands a collection into positional arguments, while splatty-splat expands a dictionary into keyword arguments.** ```python args = (1, 2) kwargs = {'x': 3, 'y': 4, 'z': 5} func(*args, **kwargs) ``` #### Is the same as: ```python func(1, 2, x=3, y=4, z=5) ``` ### Inside Function Definition **Splat combines zero or more positional arguments into a tuple, while splatty-splat combines zero or more keyword arguments into a dictionary.** ```python def add(*a): return sum(a) ``` ```python >>> add(1, 2, 3) 6 ``` #### Legal argument combinations: ```python def f(x, y, z): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) | f(1, 2, 3) def f(*, x, y, z): # f(x=1, y=2, z=3) def f(x, *, y, z): # f(x=1, y=2, z=3) | f(1, y=2, z=3) def f(x, y, *, z): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) ``` ```python def f(*args): # f(1, 2, 3) def f(x, *args): # f(1, 2, 3) def f(*args, z): # f(1, 2, z=3) def f(x, *args, z): # f(1, 2, z=3) ``` ```python def f(**kwargs): # f(x=1, y=2, z=3) def f(x, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) def f(*, x, **kwargs): # f(x=1, y=2, z=3) ``` ```python def f(*args, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) | f(1, 2, 3) def f(x, *args, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) | f(1, 2, 3) def f(*args, y, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) def f(x, *args, z, **kwargs): # f(x=1, y=2, z=3) | f(1, y=2, z=3) | f(1, 2, z=3) ``` ### Other Uses ```python = [* [, ...]] = {* [, ...]} = (*, [...]) = {** [, ...]} ``` ```python head, *body, tail = ``` Inline ------ ### Lambda ```python = lambda: = lambda , : ``` ### Comprehension ```python = [i+1 for i in range(10)] # [1, 2, ..., 10] = {i for i in range(10) if i > 5} # {6, 7, 8, 9} = (i+5 for i in range(10)) # (5, 6, ..., 14) = {i: i*2 for i in range(10)} # {0: 0, 1: 2, ..., 9: 18} ``` ```python out = [i+j for i in range(10) for j in range(10)] ``` #### Is the same as: ```python out = [] for i in range(10): for j in range(10): out.append(i+j) ``` ### Map, Filter, Reduce ```python from functools import reduce = map(lambda x: x + 1, range(10)) # (1, 2, ..., 10) = filter(lambda x: x > 5, range(10)) # (6, 7, 8, 9) = reduce(lambda out, x: out + x, range(10)) # 45 ``` ### Any, All ```python = any() # False if empty. = all(el[1] for el in ) # True if empty. ``` ### If - Else ```python if else ``` ```python >>> [a if a else 'zero' for a in (0, 1, 0, 3)] ['zero', 1, 'zero', 3] ``` ### Namedtuple, Enum, Dataclass ```python from collections import namedtuple Point = namedtuple('Point', 'x y') point = Point(0, 0) ``` ```python from enum import Enum Direction = Enum('Direction', 'n e s w') direction = Direction.n ``` ```python from dataclasses import make_dataclass Creature = make_dataclass('Creature', ['location', 'direction']) creature = Creature(Point(0, 0), Direction.n) ``` Closure ------- **We have a closure in Python when:** * **A nested function references a value of its enclosing function and then** * **the enclosing function returns the nested function.** ```python def get_multiplier(a): def out(b): return a * b return out ``` ```python >>> multiply_by_3 = get_multiplier(3) >>> multiply_by_3(10) 30 ``` * **If multiple nested functions within enclosing function reference the same value, that value gets shared.** * **To dynamically access function's first free variable use `'.__closure__[0].cell_contents'`.** ### Partial ```python from functools import partial = partial( [, , , ...]) ``` ```python >>> import operator as op >>> multiply_by_3 = partial(op.mul, 3) >>> multiply_by_3(10) 30 ``` * **Partial is also useful in cases when a function needs to be passed as an argument, because it enables us to set its arguments beforehand.** * **A few examples being `'defaultdict()'`, `'iter(, to_exclusive)'` and dataclass's `'field(default_factory=)'`.** ### Nonlocal **If variable is being assigned to anywhere in the scope, it is regarded as a local variable, unless it is declared as a 'global' or a 'nonlocal'.** ```python def get_counter(): i = 0 def out(): nonlocal i i += 1 return i return out ``` ```python >>> counter = get_counter() >>> counter(), counter(), counter() (1, 2, 3) ``` Decorator --------- **A decorator takes a function, adds some functionality and returns it.** ```python @decorator_name def function_that_gets_passed_to_decorator(): ... ``` ### Debugger Example **Decorator that prints function's name every time it gets called.** ```python from functools import wraps def debug(func): @wraps(func) def out(*args, **kwargs): print(func.__name__) return func(*args, **kwargs) return out @debug def add(x, y): return x + y ``` * **Wraps is a helper decorator that copies metadata of function func() to function out().** * **Without it `'add.__name__'` would return `'out'`.** ### LRU Cache **Decorator that caches function's return values. All function's arguments must be hashable.** ```python from functools import lru_cache @lru_cache(maxsize=None) def fib(n): return n if n < 2 else fib(n-2) + fib(n-1) ``` * **Recursion depth is limited to 1000 by default. To increase it use `'sys.setrecursionlimit()'`.** ### Parametrized Decorator **A decorator that accepts arguments and returns a normal decorator that accepts a function.** ```python from functools import wraps def debug(print_result=False): def decorator(func): @wraps(func) def out(*args, **kwargs): result = func(*args, **kwargs) print(func.__name__, result if print_result else '') return result return out return decorator @debug(print_result=True) def add(x, y): return x + y ``` Class ----- ```python class : def __init__(self, a): self.a = a def __repr__(self): class_name = self.__class__.__name__ return f'{class_name}({self.a!r})' def __str__(self): return str(self.a) @classmethod def get_class_name(cls): return cls.__name__ ``` * **Return value of repr() should be unambiguous and of str() readable.** * **If only repr() is defined, it will also be used for str().** #### Str() use cases: ```python print() print(f'{}') raise Exception() loguru.logger.debug() csv.writer().writerow([]) ``` #### Repr() use cases: ```python print([]) print(f'{!r}') >>> loguru.logger.exception() Z = dataclasses.make_dataclass('Z', ['a']); print(Z()) ``` ### Constructor Overloading ```python class : def __init__(self, a=None): self.a = a ``` ### Inheritance ```python class Person: def __init__(self, name, age): self.name = name self.age = age class Employee(Person): def __init__(self, name, age, staff_num): super().__init__(name, age) self.staff_num = staff_num ``` ### Multiple Inheritance ```python class A: pass class B: pass class C(A, B): pass ``` **MRO determines the order in which parent classes are traversed when searching for a method:** ```python >>> C.mro() [, , , ] ``` ### Property ```python class MyClass: @property def a(self): return self._a @a.setter def a(self, value): self._a = value ``` ```python >>> el = MyClass() >>> el.a = 123 >>> el.a 123 ``` ### Dataclass **Decorator that automatically generates init(), repr() and eq() special methods.** ```python from dataclasses import dataclass, field @dataclass(order=False, frozen=False) class : : : = : list/dict/set = field(default_factory=list/dict/set) ``` * **Objects can be made sortable with `'order=True'` or immutable and hashable with `'frozen=True'`.** * **Function field() is needed because `': list = []'` would make a list that is shared among all instances.** * **Default_factory can be any [callable](#callable).** ### Slots **Mechanism that restricts objects to attributes listed in 'slots' and significantly reduces their memory footprint.** ```python class MyClassWithSlots: __slots__ = ['a'] def __init__(self): self.a = 1 ``` ### Copy ```python from copy import copy, deepcopy = copy() = deepcopy() ``` Duck Types ---------- **A duck type is an implicit type that prescribes a set of special methods. Any object that has those methods defined is considered a member of that duck type.** ### Comparable * **If eq() method is not overridden, it returns `'id(self) == id(other)'`, which is the same as `'self is other'`.** * **That means all objects compare not equal by default.** * **Only the left side object has eq() method called, unless it returns NotImplemented, in which case the right object is consulted.** ```python class MyComparable: def __init__(self, a): self.a = a def __eq__(self, other): if isinstance(other, type(self)): return self.a == other.a return NotImplemented ``` ### Hashable * **Hashable object needs both hash() and eq() methods and its hash value should never change.** * **Hashable objects that compare equal must have the same hash value, meaning default hash() that returns `'id(self)'` will not do.** * **That is why Python automatically makes classes unhashable if you only implement eq().** ```python class MyHashable: def __init__(self, a): self._a = copy.deepcopy(a) @property def a(self): return self._a def __eq__(self, other): if isinstance(other, type(self)): return self.a == other.a return NotImplemented def __hash__(self): return hash(self.a) ``` ### Sortable * **With 'total_ordering' decorator you only need to provide eq() and one of lt(), gt(), le() or ge() special methods.** ```python from functools import total_ordering @total_ordering class MySortable: def __init__(self, a): self.a = a def __eq__(self, other): if isinstance(other, type(self)): return self.a == other.a return NotImplemented def __lt__(self, other): if isinstance(other, type(self)): return self.a < other.a return NotImplemented ``` ### Iterator * **Next() should return next item or raise StopIteration.** * **Iter() should return 'self'.** ```python class Counter: def __init__(self): self.i = 0 def __next__(self): self.i += 1 return self.i def __iter__(self): return self ``` ```python >>> counter = Counter() >>> next(counter), next(counter), next(counter) (1, 2, 3) ``` ### Callable * **All functions and classes have a call() method, hence are callable.** * **When this cheatsheet uses `''` for an argument, it actually means `''`.** ```python class Counter: def __init__(self): self.i = 0 def __call__(self): self.i += 1 return self.i ``` ```python >>> counter = Counter() >>> counter(), counter(), counter() (1, 2, 3) ``` ### Context Manager * **Enter() should lock the resources and return an object.** * **Exit() should release the resources.** ```python class MyOpen(): def __init__(self, filename): self.filename = filename def __enter__(self): self.file = open(self.filename) return self.file def __exit__(self, *args): self.file.close() ``` ```python >>> with open('test.txt', 'w') as file: ... file.write('Hello World!') >>> with MyOpen('test.txt') as file: ... print(file.read()) Hello World! ``` #### List of covered context managers: ```python with open('') as file: ... with wave.open('') as wave_file: ... with memoryview() as view: ... with concurrent.futures.ThreadPoolExecutor() as executor: ... db = sqlite3.connect(''); with db: ... lock = threading.RLock(); with lock: ... ``` Iterable Duck Types ------------------- ### Iterable * **Only required method is iter(). It should return an iterator of object's items.** * **Contains() automatically works on any object that has iter() defined.** ```python class MyIterable: def __init__(self, a): self.a = a def __iter__(self): for el in self.a: yield el ``` ```python >>> z = MyIterable([1, 2, 3]) >>> iter(z) >>> 1 in z True ``` ### Collection * **Only required methods are iter() and len().** * **This cheatsheet actually means `''` when it uses `''`.** * **I chose not to use the name 'iterable' because it sounds scarier and more vague than 'collection'.** ```python class MyCollection: def __init__(self, a): self.a = a def __iter__(self): return iter(self.a) def __contains__(self, el): return el in self.a def __len__(self): return len(self.a) ``` ### Sequence * **Only required methods are len() and getitem().** * **Getitem() should return an item at index or raise IndexError.** * **Iter() and contains() automatically work on any object that has getitem() defined.** * **Reversed() automatically works on any object that has getitem() and len() defined.** ```python class MySequence: def __init__(self, a): self.a = a def __iter__(self): return iter(self.a) def __contains__(self, el): return el in self.a def __len__(self): return len(self.a) def __getitem__(self, i): return self.a[i] def __reversed__(self): return reversed(self.a) ``` ### Collections.abc.Sequence * **It's a richer interface than the basic sequence.** * **Extending it generates iter(), contains(), reversed(), index(), and count().** * **Unlike `'abc.Iterable'` and `'abc.Collection'`, it is not a duck type. That is why `'issubclass(MySequence, collections.abc.Sequence)'` would return False even if MySequence had all the methods defined.** ```python class MyAbcSequence(collections.abc.Sequence): def __init__(self, a): self.a = a def __len__(self): return len(self.a) def __getitem__(self, i): return self.a[i] ``` #### Table of required and available special methods: ```text +------------+----------+------------+----------+--------------+ | | Iterable | Collection | Sequence | abc.Sequence | +------------+----------+------------+----------+--------------+ | iter() | REQ | REQ | yes | yes | | contains() | yes | yes | yes | yes | | len() | | REQ | REQ | REQ | | getitem() | | | REQ | REQ | | reversed() | | | yes | yes | | index() | | | | yes | | count() | | | | yes | +------------+----------+------------+----------+--------------+ ``` * **Other ABCs that generate missing methods are: MutableSequence, Set, MutableSet, Mapping and MutableMapping. Required methods: `'.__abstractmethods__'`.** Enum ---- ```python from enum import Enum, auto class (Enum): = = , = auto() @classmethod def get_member_names(cls): return [a.name for a in cls.__members__.values()] ``` * **If there are no numeric values before auto(), it returns 1.** * **Otherwise it returns an increment of last numeric value.** ```python = . # Returns a member. = [''] # Returns a member or raises KeyError. = () # Returns a member or raises ValueError. name = .name value = .value ``` ```python list_of_members = list() member_names = [a.name for a in ] member_values = [a.value for a in ] random_member = random.choice(list()) ``` ### Inline ```python Cutlery = Enum('Cutlery', ['fork', 'knife', 'spoon']) Cutlery = Enum('Cutlery', 'fork knife spoon') Cutlery = Enum('Cutlery', {'fork': 1, 'knife': 2, 'spoon': 3}) ``` #### Functions can not be values, so they must be wrapped: ```python from functools import partial LogicOp = Enum('LogicOp', {'AND': partial(lambda l, r: l and r), 'OR' : partial(lambda l, r: l or r)}) ``` * **Another solution in this particular case, is to use `'and_'` and `'or_'` functions from module [operator](#operator).** Exceptions ---------- ### Basic Example ```python try: except : ``` ### Complex Example ```python try: except : except : else: finally: ``` ### Catching Exceptions ```python except : except as : except (, ...): except (, ...) as : ``` * **Also catches subclasses of the exception.** ### Raising Exceptions ```python raise raise () raise () raise (, ...) ``` #### Useful built-in exceptions: ```python raise ValueError('Argument is of right type but inappropriate value!') raise TypeError('Argument is of wrong type!') raise RuntimeError('None of above!') ``` #### Re-raising caught exception: ```python except : raise ``` ### Common Built-in Exceptions ```text BaseException +-- SystemExit # Raised by the sys.exit() function. +-- KeyboardInterrupt # Raised when the user hits the interrupt key. +-- Exception # User-defined exceptions should be derived from this class. +-- StopIteration # Raised by next() when run on an empty iterator. +-- ArithmeticError # Base class for arithmetic errors. | +-- ZeroDivisionError # Raised when dividing by zero. +-- AttributeError # Raised when an attribute is missing. +-- EOFError # Raised by input() when it hits end-of-file condition. +-- LookupError # Raised when a look-up on a sequence or dict fails. | +-- IndexError # Raised when a sequence index is out of range. | +-- KeyError # Raised when a dictionary key is not found. +-- NameError # Raised when a variable name is not found. +-- OSError # Failures such as “file not found” or “disk full”. | +-- FileNotFoundError # When a file or directory is requested but doesn't exist. +-- RuntimeError # Raised by errors that don't fall in other categories. | +-- RecursionError # Raised when the the maximum recursion depth is exceeded. +-- TypeError # Raised when an argument is of wrong type. +-- ValueError # When an argument is of right type but inappropriate value. +-- UnicodeError # Raised when encoding/decoding strings from/to bytes fails. ``` #### Collections and their exceptions: ```text +-----------+------------+----------+----------+ | | list | dict | set | +-----------+------------+----------+----------+ | getitem() | IndexError | KeyError | | | pop() | IndexError | KeyError | KeyError | | remove() | ValueError | | KeyError | | index() | ValueError | | | +-----------+------------+----------+----------+ ``` ### User-defined Exceptions ```python class MyError(Exception): pass class MyInputError(MyError): pass ``` Print ----- ```python print(, ..., sep=' ', end='\n', file=sys.stdout, flush=False) ``` * **Use `'file=sys.stderr'` for errors.** * **Use `'flush=True'` to forcibly flush the stream.** ### Pretty Print ```python from pprint import pprint pprint(, width=80, depth=None) ``` * **Levels deeper than 'depth' get replaced by '...'.** Input ----- * **Reads a line from user input or pipe if present.** * **Trailing newline gets stripped.** * **Prompt string is printed to the standard output before reading input.** * **Raises EOFError when user hits EOF or input stream gets exhausted.** ```python = input(prompt=None) ``` Command Line Arguments ---------------------- ```python import sys script_name = sys.argv[0] arguments = sys.argv[1:] ``` ### Argparse ```python from argparse import ArgumentParser, FileType p = ArgumentParser(description=) p.add_argument('-', '--', action='store_true') # Flag p.add_argument('-', '--', type=) # Option p.add_argument('', type=, nargs=1) # First argument p.add_argument('', type=, nargs='+') # Remaining arguments p.add_argument('', type=, nargs='*') # Optional arguments args = p.parse_args() # Exits on error. value = args. ``` * **Use `'help='` to set argument description.** * **Use `'default='` to set the default value.** * **Use `'type=FileType()'` for files.** Open ---- **Opens a file and returns a corresponding file object.** ```python = open('', mode='r', encoding=None, newline=None) ``` * **`'encoding=None'` means default encoding is used, which is platform dependent. Best practice is to use `'encoding="utf-8"'` whenever possible.** * **`'newline=None'` means all different end of line combinations are converted to '\n' on read, while on write all '\n' characters are converted to system's default line separator.** * **`'newline=""'` means no conversions take place, but input is still broken into chunks by readline() and readlines() on either '\n', '\r' or '\r\n'.** ### Modes * **`'r'` - Read (default).** * **`'w'` - Write (truncate).** * **`'x'` - Write or fail if the file already exists.** * **`'a'` - Append.** * **`'w+'` - Read and write (truncate).** * **`'r+'` - Read and write from the start.** * **`'a+'` - Read and write from the end.** * **`'t'` - Text mode (default).** * **`'b'` - Binary mode.** ### Exceptions * **`'FileNotFoundError'` can be risen when reading with `'r'` or `'r+'`.** * **`'FileExistsError'` can be risen when writing with `'x'`.** * **`'IsADirectoryError'` and `'PermissionError'` can be risen by any.** * **`'OSError'` is the parent class of all listed exceptions.** ### File ```python .seek(0) # Moves to the start of the file. .seek(offset) # Moves 'offset' chars/bytes from the start. .seek(0, 2) # Moves to the end of the file. .seek(±offset, ) # Anchor: 0 start, 1 current pos., 2 end. ``` ```python = .read(size=-1) # Reads 'size' chars/bytes or until EOF. = .readline() # Returns a line or empty string on EOF. = .readlines() # Returns a list of remaining lines. = next() # Returns a line using buffer. Do not mix. ``` ```python .write() # Writes a string or bytes object. .writelines() # Writes a coll. of strings or bytes objects. .flush() # Flushes write buffer. ``` * **Methods do not add or strip trailing newlines, even writelines().** ### Read Text from File ```python def read_file(filename): with open(filename, encoding='utf-8') as file: return file.readlines() ``` ### Write Text to File ```python def write_to_file(filename, text): with open(filename, 'w', encoding='utf-8') as file: file.write(text) ``` Path ---- ```python from os import path, listdir from glob import glob ``` ```python = path.exists('') = path.isfile('') = path.isdir('') ``` ```python = listdir('') # List of filenames located at path. = glob('') # Filenames matching the wildcard pattern. ``` ### Pathlib ```python from pathlib import Path ``` ```python cwd = Path() = Path('' [, '', , ...]) = / '' / '' ``` ```python = .exists() = .is_file() = .is_dir() ``` ```python = .iterdir() # Returns dir contents as Path objects. = .glob('') # Returns Paths matching the wildcard pattern. ``` ```python = str() # Path as a string. = .name # Final component. = .stem # Final component without extension. = .suffix # Final component's extension. = .parts # All components as strings. ``` ```python = .resolve() # Returns absolute path without symlinks. = .parent # Returns path without final component. = open() # Opens the file and returns a file object. ``` Command Execution ----------------- ### Files and Directories * **Paths can be either strings, Paths, or DirEntry objects.** * **Functions report OS related errors by raising either OSError or one of its [subclasses](#exceptions-1).** ```python import os, shutil ``` ```python os.chdir() # Changes current working directory. os.mkdir(, mode=0o777) # Creates a directory. ``` ```python os.rename(from, to) # Renames the file or directory. os.replace(from, to) # Same, but overwrites 'to' if it exists. ``` ```python os.remove() # Deletes the file. os.rmdir() # Deletes empty directory. shutil.rmtree() # Deletes the entire directory tree. ``` ```python shutil.copy(from, to) # Copies the file. shutil.copytree(from, to) # Copies the entire directory tree. ``` ```python = os.getcwd() # Returns the current working directory. = os.scandir(path='.') # Returns os.DirEntry objects located at path. ``` #### DirEntry: ```python = .is_file() = .is_dir() ``` ```python = .path # Path as a string. = .name # Final component. ``` ```python = Path() # Path object. = open() # File object. ``` ### Shell Commands ```python import os = os.popen('').read() ``` #### Using subprocess: ```python >>> import subprocess, shlex >>> a = subprocess.run(shlex.split('ls -a'), stdout=subprocess.PIPE) >>> a.stdout b'.\n..\nfile1.txt\nfile2.txt\n' >>> a.returncode 0 ``` CSV --- ```python import csv ``` ### Read ```python = csv.reader(, dialect='excel', delimiter=',') = next() # Returns next row as a list of strings. = list() # Returns list of remaining rows. ``` * **File must be opened with `'newline=""'` argument, or newlines embedded inside quoted fields will not be interpreted correctly!** ### Write ```python = csv.writer(, dialect='excel', delimiter=',') .writerow() # Encodes objects using `str()`. .writerows() # Appends multiple rows. ``` * **File must be opened with `'newline=""'` argument, or an extra '\r' will be added on platforms that use '\r\n' linendings!** ### Parameters * **`'dialect'` - Master parameter that sets the default values.** * **`'delimiter'` - A one-character string used to separate fields.** * **`'quotechar'` - Character for quoting fields that contain special characters.** * **`'doublequote'` - Whether quotechars inside fields get doubled or escaped.** * **`'skipinitialspace'` - Whether whitespace after delimiter gets stripped.** * **`'lineterminator'` - How does writer terminate lines.** * **`'quoting'` - Controls the amount of quoting: 0 - as necessary, 1 - all.** * **`'escapechar'` - Character for escaping 'quotechar' if 'doublequote' is false.** ### Dialects ```text +------------------+-----------+-----------+--------------+ | | excel | excel_tab | unix_dialect | +------------------+-----------+-----------+--------------+ | delimiter | ',' | '\t' | ',' | | quotechar | '"' | '"' | '"' | | doublequote | True | True | True | | skipinitialspace | False | False | False | | lineterminator | '\r\n' | '\r\n' | '\n' | | quoting | 0 | 0 | 1 | | escapechar | None | None | None | +------------------+-----------+-----------+--------------+ ``` ### Read Rows from CSV File ```python def read_csv_file(filename): with open(filename, encoding='utf-8', newline='') as file: return list(csv.reader(file)) ``` ### Write Rows to CSV File ```python def write_to_csv_file(filename, rows): with open(filename, 'w', encoding='utf-8', newline='') as file: writer = csv.writer(file) writer.writerows(rows) ``` SQLite ------ **Server-less database engine that stores each database into separate file.** ```python import sqlite3 db = sqlite3.connect('') # Also ':memory:'. ... db.close() ``` * **New database will be created if path doesn't exist.** ### Read ```python = db.execute('') # Can raise sqlite3.OperationalError. = .fetchone() # Returns next row. Also next(). = .fetchall() # Returns remaining rows. ``` * **Returned values can be of type str, int, float, bytes or None.** ### Write ```python db.execute('') db.commit() ``` #### Or: ```python with db: db.execute('') ``` ### Placeholders ```python db.execute('', ) # Replaces '?'s in query with values. db.execute('', ) # Replaces ':'s with values. db.executemany('', ) # Runs execute() many times. ``` * **Passed values can be of type str, int, float, bytes, None, bool, datetime.date or datetime.datetme.** * **Bools will be stored and returned as ints and dates as ISO formatted strings.** ### Example ```python >>> db = sqlite3.connect('test.db') >>> db.execute('create table t (a, b, c)') >>> db.execute('insert into t values (1, 2, 3)') >>> db.execute('select * from t').fetchall() [(1, 2, 3)] ``` * **In this example values are not actually saved because `'db.commit()'` was omitted.** ### MySQL **Has a very similar interface, with differences listed below.** ```python # $ pip3 install mysql-connector from mysql import connector db = connector.connect(host=, user=, password=, database=) = db.cursor() .execute('') # Only cursor has execute method. .execute('', ) # Replaces '%s's in query with values. .execute('', ) # Replaces '%()s's with values. ``` JSON ---- ```python import json = json.dumps(, ensure_ascii=True, indent=None) = json.loads() ``` ### Read Object from JSON File ```python def read_json_file(filename): with open(filename, encoding='utf-8') as file: return json.load(file) ``` ### Write Object to JSON File ```python def write_to_json_file(filename, an_object): with open(filename, 'w', encoding='utf-8') as file: json.dump(an_object, file, ensure_ascii=False, indent=2) ``` Pickle ------ ```python import pickle = pickle.dumps() = pickle.loads() ``` ### Read Object from File ```python def read_pickle_file(filename): with open(filename, 'rb') as file: return pickle.load(file) ``` ### Write Object to File ```python def write_to_pickle_file(filename, an_object): with open(filename, 'wb') as file: pickle.dump(an_object, file) ``` Bytes ----- **Bytes object is an immutable sequence of single bytes. Mutable version is called 'bytearray'.** ```python = b'' # Only accepts ASCII characters and \x00 - \xff. = [] # Returns int in range from 0 to 255. = [] # Returns bytes even if it has only one element. = .join() # Joins elements using bytes object as separator. ``` ### Encode ```python = bytes() # Ints must be in range from 0 to 255. = bytes(, 'utf-8') # Or: .encode('utf-8') = .to_bytes(n_bytes, byteorder='big|little', signed=False) = bytes.fromhex('') ``` ### Decode ```python = list() # Returns ints in range from 0 to 255. = str(, 'utf-8') # Or: .decode('utf-8') = int.from_bytes(, byteorder='big|little', signed=False) '' = .hex() ``` ### Read Bytes from File ```python def read_bytes(filename): with open(filename, 'rb') as file: return file.read() ``` ### Write Bytes to File ```python def write_bytes(filename, bytes_obj): with open(filename, 'wb') as file: file.write(bytes_obj) ``` Struct ------ * **Module that performs conversions between a sequence of numbers and a bytes object.** * **Machine’s native type sizes and byte order are used by default.** ```python from struct import pack, unpack, iter_unpack = pack('', [, , ...]) = unpack('', ) = iter_unpack('', ) ``` ### Example ```python >>> pack('>hhl', 1, 2, 3) b'\x00\x01\x00\x02\x00\x00\x00\x03' >>> unpack('>hhl', b'\x00\x01\x00\x02\x00\x00\x00\x03') (1, 2, 3) ``` ### Format #### For standard sizes start format string with: * **`'='` - native byte order** * **`'<'` - little-endian** * **`'>'` - big-endian** #### Integer types. Use capital letter for unsigned type. Standard sizes are in brackets: * **`'x'` - pad byte** * **`'b'` - char (1)** * **`'h'` - short (2)** * **`'i'` - int (4)** * **`'l'` - long (4)** * **`'q'` - long long (8)** #### Floating point types: * **`'f'` - float (4)** * **`'d'` - double (8)** Array ----- **List that can only hold numbers of a predefined type. Available types and their sizes in bytes are listed above.** ```python from array import array = array('', ) # Array from coll. of numbers. = array('', ) # Array from bytes object. = .tobytes() ``` Memory View ----------- * **Memory View is a seqence that points to the memory of bytes, bytearray or array objects.** * **Each element can reference a single or multiple consecutive bytes.** * **Referenced elements can be narrowed down with slicing.** ```python = memoryview() = [] # Can be int or float. = [] # Mview with rearanged elements. = .cast('') # Cast a memoryview to a new format. .release() # Releases the buffer. ``` ```python .write() = bytes() # Or: .tobytes() = .join() # Joins mviews using bytes object as sep. = list() # Returns numbers. Or: .tolist() = str(, 'utf-8') # Or: .decode('utf-8') = int.from_bytes(, byteorder='big|little', signed=False) '' = .hex() ``` Deque ----- **A thread-safe list with efficient appends and pops from either side. Pronounced "deck".** ```python from collections import deque = deque(, maxlen=None) ``` ```python .appendleft() # Opposite element is dropped if full. = .popleft() # Raises IndexError if empty. .extendleft() # Collection gets reversed. .rotate(n=1) # Rotates elements to the right. ``` Threading --------- * **CPython interpreter can only run a single thread at a time.** * **That is why using multiple threads won't result in a faster execution, unless there is an I/O operation in the thread.** ```python from threading import Thread, RLock ``` ### Thread ```python thread = Thread(target=, args=(, )) thread.start() ... = thread.is_alive() # Checks if thread has finished executing. thread.join() # Waits for thread to finish. ``` ### Lock ```python lock = RLock() lock.acquire() # Waits for lock to be available. ... lock.release() ``` #### Or: ```python lock = RLock() with lock: ... ``` ### Thread Pool ```python from concurrent.futures import ThreadPoolExecutor with ThreadPoolExecutor(max_workers=None) as executor: = executor.map(lambda x: x + 1, range(3)) # (1, 2, 3) = executor.map(lambda x, y: x + y, 'abc', '123') # ('a1', 'b2', 'c3') = executor.submit( [, , ...]) ``` ```python = .done() # Checks if thread has finished executing. = .result() # Waits for thread to finish and returns result. ``` ### Queue **A thread-safe FIFO queue. For LIFO queue use LifoQueue.** ```python from queue import Queue = Queue(maxsize=0) ``` ```python .put() # Blocks until queue stops being full. .put_nowait() # Raises queue.Full exception if full. = .get() # Blocks until queue stops being empty. = .get_nowait() # Raises _queue.Empty exception if empty. ``` Operator -------- ```python from operator import add, sub, mul, truediv, floordiv, mod, pow, neg, abs from operator import eq, ne, lt, le, gt, ge from operator import and_, or_, not_ from operator import itemgetter, attrgetter, methodcaller ``` ```python import operator as op sorted_by_second = sorted(, key=op.itemgetter(1)) sorted_by_both = sorted(, key=op.itemgetter(1, 0)) product_of_elems = functools.reduce(op.mul, ) LogicOp = enum.Enum('LogicOp', {'AND': op.and_, 'OR' : op.or_}) last_el = op.methodcaller('pop')() ``` Introspection ------------- **Inspecting code at runtime.** ### Variables ```python = dir() # Names of variables in current scope. = locals() # Dict of local variables. Also vars(). = globals() # Dict of global variables. ``` ### Attributes ```python = vars() = hasattr(, '') value = getattr(, '') setattr(, '', value) ``` ### Parameters ```python from inspect import signature = signature() no_of_params = len(.parameters) param_names = list(.parameters.keys()) ``` Metaprograming -------------- **Code that generates code.** ### Type **Type is the root class. If only passed an object it returns its type (class). Otherwise it creates a new class.** ```python = type(, , ) ``` ```python >>> Z = type('Z', (), {'a': 'abcde', 'b': 12345}) >>> z = Z() ``` ### Meta Class **Class that creates classes.** ```python def my_meta_class(name, parents, attrs): attrs['a'] = 'abcde' return type(name, parents, attrs) ``` #### Or: ```python class MyMetaClass(type): def __new__(cls, name, parents, attrs): attrs['a'] = 'abcde' return type.__new__(cls, name, parents, attrs) ``` * **New() is a class method that gets called before init(). If it returns an instance of its class, then that instance gets passed to init() as a 'self' argument.** * **It receives the same arguments as init(), except for the first one that specifies the desired class of returned instance (MyMetaClass in our case).** * **New() can also be called directly, usually from a new() method of a child class (**`def __new__(cls): return super().__new__(cls)`**), in which case init() is not called.** ### Metaclass Attribute **Right before a class is created it checks if it has metaclass attribute defined. If not, it recursively checks if any of his parents has it defined and eventually comes to type().** ```python class MyClass(metaclass=MyMetaClass): b = 12345 ``` ```python >>> MyClass.a, MyClass.b ('abcde', 12345) ``` ### Type Diagram ```python type(MyClass) == MyMetaClass # MyClass is an instance of MyMetaClass. type(MyMetaClass) == type # MyMetaClass is an instance of type. ``` ```text +---------+-------------+ | Classes | Metaclasses | +---------+-------------| | MyClass > MyMetaClass | | | v | | object ---> type <+ | | | ^ +---+ | | str -------+ | +---------+-------------+ ``` ### Inheritance Diagram ```python MyClass.__base__ == object # MyClass is a subclass of object. MyMetaClass.__base__ == type # MyMetaClass is a subclass of type. ``` ```text +---------+-------------+ | Classes | Metaclasses | +---------+-------------| | MyClass | MyMetaClass | | v | v | | object <--- type | | ^ | | | str | | +---------+-------------+ ``` Eval ---- ```python >>> from ast import literal_eval >>> literal_eval('1 + 2') 3 >>> literal_eval('[1, 2, 3]') [1, 2, 3] >>> literal_eval('abs(1)') ValueError: malformed node or string ``` Coroutine --------- * **Any function that contains a `'(yield)'` expression returns a coroutine.** * **Coroutines are similar to iterators, but data needs to be pulled out of an iterator by calling `'next()'`, while we push data into the coroutine by calling `'.send()'`.** * **Coroutines provide more powerful data routing possibilities than iterators.** ### Helper Decorator * **All coroutines must first be "primed" by calling `'next()'`.** * **Remembering to call next() is easy to forget.** * **Solved by wrapping functions that return a coroutine with a decorator:** ```python def coroutine(func): def out(*args, **kwargs): cr = func(*args, **kwargs) next(cr) return cr return out ``` ### Pipeline Example ```python def reader(target): for i in range(10): target.send(i) target.close() @coroutine def adder(target): while True: value = (yield) target.send(value + 100) @coroutine def printer(): while True: value = (yield) print(value) reader(adder(printer())) # 100, 101, ..., 109 ```
Libraries ========= Progress Bar ------------ ```python # $ pip3 install tqdm from tqdm import tqdm from time import sleep for el in tqdm([1, 2, 3]): sleep(0.2) ``` Plot ---- ```python # $ pip3 install matplotlib from matplotlib import pyplot pyplot.plot( [, label=]) pyplot.plot(, ) pyplot.legend() # Adds a legend. pyplot.savefig() # Saves figure. pyplot.show() # Displays figure. pyplot.clf() # Clears figure. ``` Table ----- #### Prints a CSV file as an ASCII table: ```python # $ pip3 install tabulate import csv, tabulate with open('test.csv', encoding='utf-8', newline='') as file: rows = csv.reader(file) header = [a.title() for a in next(rows)] table = tabulate.tabulate(rows, header) print(table) ``` Curses ------ #### Clears terminal, prints message and waits for ESC key press: ```python from curses import wrapper, curs_set, ascii from curses import KEY_UP, KEY_RIGHT, KEY_DOWN, KEY_LEFT def main(): wrapper(draw) def draw(screen): curs_set(0) # Makes cursor invisible. screen.nodelay(True) # Makes getch() non-blocking. screen.clear() screen.addstr(0, 0, 'Press ESC to quit.') while screen.getch() != ascii.ESC: pass def get_border(screen): from collections import namedtuple P = namedtuple('P', 'x y') height, width = screen.getmaxyx() return P(width-1, height-1) if __name__ == '__main__': main() ``` Logging ------- ```python # $ pip3 install loguru from loguru import logger ``` ```python logger.add('debug_{time}.log', colorize=True) # Connects a log file. logger.add('error_{time}.log', level='ERROR') # Another file for errors or higher. logger.('A logging message.') ``` * **Levels: `'debug'`, `'info'`, `'success'`, `'warning'`, `'error'`, `'critical'`.** ### Exceptions **Exception description, stack trace and values of variables are appended automatically.** ```python try: ... except : logger.exception('An error happened.') ``` ### Rotation **Argument that sets a condition when a new log file is created.** ```python rotation=||| ``` * **`''` - Max file size in bytes.** * **`''` - Max age of a file.** * **`'