programming [Cygnus]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Programming ======
  * github repository to learn courses ии репозиторий учебник - https://github.com/The-Pocket/Tutorial-Codebase-Knowledge?tab=readme-ov-file
  * https://roadmap.sh/roadmaps - road maps
  * algoexpert - site with algorithms
  * https://visualgo.net/en - algorithms visualize (https://habr.com/ru/company/gnivc/blog/689770/ описание)
  * https://codersrank.io/ - popularity instruments
  * https://insights.stackoverflow.com/
  * [[https://www.techempower.com/benchmarks/#section=data-r19&hw=ph&test=fortune&l=ziiwhr-1r|web frammework ranks]]
  * colorer site color and format source for copy - http://hilite.me/
  * Kubernetes https://m.habr.com/ru/company/mailru/blog/465823/#1
  * Angularcomponent https://blog.bitsrc.io/11-angular-component-libraries-you-should-know-in-2018-e9f9c9d544ff
  * https://www.codota.com/setup/vscode - codota AI Code Completions 
  * https://www.tabnine.com/?utm_source=search-web - vscode ai code completion


  * search code grep - ''grep -inIEr -C1 –include="*.java" "codere*" ./src/''


===== Programming backlog =====
<WRAP group>
<WRAP half column>
Какие подходы и методологии Вы применяли для формирования бэклога и проектирования функциональности продукта в этом году?
  * СJM, UJM
  * Service Blueprint
  * Jobs to be done и Job Story
  * User Story и User Story Mapping
  * Use Case
  * UML
  * Текстовое описание по собственным шаблонам
  * Другое (укажите, что именно)
</WRAP>

<WRAP half column>
Какие способы визуализации и моделирования Вы применяли в этом году?
  * IDEF0
  * BPMN
  * EPC
  * Блок-схемы
  * UML
  * User Flow, UJM
  * Прототипы и мокапы интерфейсов
  * Другое (укажите, что именно)
</WRAP>
</WRAP>
====== Programming.stacks стэк ======
  * [[https://stackshare.io/stackups/trending|stack compare and tools choosing]]

====== Programming.concepts ======
  * [[https://www.youtube.com/watch?v=-uleG_Vecis|100+ Computer Science Concepts Explained]]
====== O notation  ======
  * O notation \\
{{::onotation.webp?400}} \\
===== Popularity популярность =====
  * https://madnight.github.io/githut/#/pull_requests/2022/1 https://githut.info/
  * https://survey.stackoverflow.co/2022/


===== MarkDown =====
markdown online editor <https://mk-down2.vercel.app/>  <https://stackedit.io/> \\
===== HTTP =====
===== HTML =====

  * [[https://caniuse.com|can i use]] 
  * [[https://www.dunebook.com/21-chrome-extensions-for-web-development/|chrome development extensions]]
  * https://github.com/apollographql
  * https://github.com/APIs-guru/graphql-voyager - graphql voyager
  * https://api.prisma-cms.com/ api prisma 

  * https://squoosh.app/editor - picture image optimize  [[https://www.smashingmagazine.com/2021/09/modern-image-formats-avif-webp/|smashingmagazine modern image formats 2021]]


  * нагрузочное тестирование
  * ++ Web Scrapping web download scrap|
<code javascript>
(async function downloadCompleteHTML() {
  // Helper function to fetch content of external files (CSS, JS, images)
  async function fetchResource(url, isBinary = false) {
    try {
      const response = await fetch(url);
      if (isBinary) {
        const blob = await response.blob();
        return new Promise((resolve, reject) => {
          const reader = new FileReader();
          reader.onloadend = () => resolve(reader.result);
          reader.onerror = reject;
          reader.readAsDataURL(blob);
        });
      } else {
        return await response.text();
      }
    } catch (error) {
      console.warn('Failed to fetch resource:', url);
      return '';
    }
  }

  // Helper function to inline external CSS and convert relative URLs to absolute
  async function inlineCSS(linkElement) {
    const href = linkElement.href;
    const cssContent = await fetchResource(href);

    // Resolve relative URLs within CSS (for images, fonts, etc.)
    const resolvedCSS = cssContent.replace(/url\((?!['"]?(?:data|https?|ftp):)['"]?([^'")]+)['"]?\)/g, function(match, relativeUrl) {
      const absoluteUrl = new URL(relativeUrl, href).href;
      return `url(${absoluteUrl})`;
    });

    // Create a <style> tag with the inlined CSS
    const styleElement = document.createElement('style');
    styleElement.textContent = resolvedCSS;
    return styleElement;
  }

  // Helper function to convert images to base64-encoded data URIs
  async function inlineImages(element) {
    const images = element.querySelectorAll('img');
    for (let img of images) {
      if (img.src.startsWith('http')) {
        const dataUri = await fetchResource(img.src, true);
        img.src = dataUri; // Replace the src with base64-encoded data URI
      }
    }
  }

  // Get the entire DOM HTML structure
  const html = document.documentElement.outerHTML;

  // Create a new document to parse and modify the HTML content
  const parser = new DOMParser();
  const doc = parser.parseFromString(html, "text/html");

  // Inline all external CSS files
  const linkElements = [...doc.querySelectorAll('link[rel="stylesheet"]')];
  for (let link of linkElements) {
    const inlineStyleElement = await inlineCSS(link);
    link.replaceWith(inlineStyleElement);
  }

  // Inline all images as base64 data URIs
  await inlineImages(doc);

  // Get the final HTML including the modified DOM
  const finalHTML = doc.documentElement.outerHTML;

  // Create a downloadable HTML file
  const downloadHTML = (content, fileName) => {
    const a = document.createElement("a");
    const file = new Blob([content], { type: "text/html" });
    a.href = URL.createObjectURL(file);
    a.download = fileName;
    document.body.appendChild(a);
    a.click();
    document.body.removeChild(a);
  };

  // Download the final HTML file
  downloadHTML(finalHTML, "index.html");

  // Hide loading overlay
  loadingOverlay.style.display = 'none';
})();
</code>
++

==== HTML Beauty ====
   * https://www.leafgon.com/nav/breezyforest/demo - great indicator

===== SVG =====
  * Svg editor https://boxy-svg.com/app

===== CSS =====

  * https://medium.com/@eokinch/unicode-characters-in-html-css-a55c77fd3570

  * Flexbox https://css-tricks.com/snippets/css/a-guide-to-flexbox/
  * Flexbox https://mastery.games/flexboxzombies/
  * Flexbox [[https://medium.com/@stasonmars/%D0%B2%D0%B5%CC%88%D1%80%D1%81%D1%82%D0%BA%D0%B0-%D0%BD%D0%B0-flexbox-%D0%B2-css-%D0%BF%D0%BE%D0%BB%D0%BD%D1%8B%D0%B8%CC%86-%D1%81%D0%BF%D1%80%D0%B0%D0%B2%D0%BE%D1%87%D0%BD%D0%B8%D0%BA-e26662cf87e0|Вёрстка на Flexbox в CSS]]

  * TailWind Components https://tailwindcomponents.com/components/Forms

==== Bootstrap ====
  * [[https://o7planning.org/ru/11963/bootstrap-grid-system-tutorial| Learn - курс]][[https://itchief.ru/bootstrap/grid-v4|курс2]]
  * [[https://keenthemes.com/keen/preview/demo1/index.html#| Bootstrap theme example]]
  * [[https://github.com/thomaspark/bootswatch|Bootswatch Free themes]]


===== Php =====

  * for reading good site - https://stitcher.io/blog/constructor-promotion-in-php-8
==== PHP config ====
  * PHP-FPM  configure https://thisinterestsme.com/php-fpm-settings/
  * Производительность PHP: планируем, профилируем, оптимизируем https://habr.com/ru/company/badoo/blog/430722/ 
<code BASH>
#memory use of PHP https://serverfault.com/questions/1055507/php-fpm-using-100-cpu-on-a-server-that-has-16-threads
ps --no-headers -o "rss,cmd" -C php-fpm | awk '{ sum+=$1 } END { printf ("%d%s\n", sum/NR/1024,"M") }'
echo "
pm = static
pm.max_children = 25
pm.start_servers = 5
pm.min_spare_servers = 5
pm.max_spare_servers = 10
pm.max_requests = 1000
" >> to_php_ini
</code>


==== Php Laravel ====
[[programming:phplaravel|php.laravel laravel]]

==== Php MODX ====
  * [[https://docs.modx.pro/sistema/osnovyi/sintaksis-tegov|PHP modx docs]]
  * debugging [[https://habr.com/ru/post/438088/|habr_debug]] [[https://tracy.nette.org/|tracy php debug]]
  * https://webdesign-master.ru/blog/modx/ - site for learn
  * [[https://sepiariver.com/modx/5-modx-methods-you-need-to-know-about/| :!:5 modx methods nned to know]]
  * [[https://www.youtube.com/watch?v=d8hzj8Gz5xU| Запуск modx в контейнере]]
  * [[https://docs.modx.pro/sistema/osnovyi/sintaksis-tegov|DOCX Русская документация]]
  * [[https://prisma-cms.com/tasks/?status_in=New&status_in=Accepted&status_in=Progress&status_in=Paused&status_in=RevisionsRequired&status_in=Discuss&status_in=Approved&status_in=Done|Пример задачи]]
  * [[https://github.com/modmore/Gitify| Modx <-> git ]]
  * https://www.markhamstra.com/modx/2018/deprecated-notices-in-modx-2.7/ - deprecated and examples
  * https://modx.pro/development/19365 - new version of modx on php
  * https://ilyaut.ru/extjs/how-modx-extras-work-6/ - utkin how extension work
  * https://modzone.ru/blog/2020/07/25/queues-in-modx-out-of-the-box/ - очереди modx queu из коробки 
  * https://docs.modx.pro/komponentyi/pdotools/fajlovyie-elementyi - компоненты в файлех 


==== PHP.gost  ====
  * ESIA есиа https://github.com/fr05t1k/esia
  * https://vc.ru/services/209962-kak-rabotaet-identifikaciya-polzovateley-cherez-gosuslugi

==== PHP.webcheatsheets  ====
35 Website Cheat Sheets For Developers https://dev.to/haycuoilennao19/35-website-cheat-sheet-for-developer-22hk

===== Python =====
  * https://youtu.be/0Osso8mLL-A?si=wMDqSDJJRy8u1Dyh - manager UV pip on RUST https://astral.sh/blog/uv-unified-python-packaging
  * good book https://python-scripts.com/sleep
  * install pip from wheels '' python3 ./pip-19.2.2-py2.py3-none-any.whl/pip install ./pip-19.2.2-py2.py3-none-any.whl ''

  * f strings doc http://cissandbox.bentley.edu/sandbox/wp-content/uploads/2022-02-10-Documentation-on-f-strings-Updated.pdf
  * psycopg3 - postgres driver https://www.psycopg.org/psycopg3/ https://www.psycopg.org/psycopg3/docs/advanced/typing.html
  * pydantic - https://pydantic-docs.helpmanual.io/usage/validators/ - Data validation and settings management using python type annotations.
  * 
  * pudb - debugger на стероидах
  * ptpython - repl advanced
  * 
  * pandas https://www.kaggle.com/learn/pandas https://tproger.ru/translations/rewrite-sql-queries-in-pandas/






++++ Python psycopg3|
<code PYTHON>
import psycopg
import pandas as pd
conn = psycopg.connect("postgresql://eam:PASSWORD@Db:5432/UIS_MV")
with conn.cursor() as cur:
      for record in cur.execute("""
                  SELECT oid,table_schema,table_name, row_estimate::int, pg_size_pretty(total_bytes) AS total
                     , pg_size_pretty(index_bytes) AS index
                     , pg_size_pretty(toast_bytes) AS toast
                     , pg_size_pretty(table_bytes) AS table
                         FROM (
                         SELECT *, total_bytes-index_bytes-coalesce(toast_bytes,0) AS table_bytes FROM (
                             SELECT c.oid,nspname AS table_schema, relname AS table_name
                                     , c.reltuples AS row_estimate
                                     , pg_total_relation_size(c.oid) AS total_bytes
                                     , pg_indexes_size(c.oid) AS index_bytes
                                     , pg_total_relation_size(reltoastrelid) AS toast_bytes
                                 FROM pg_class c
                                 LEFT JOIN pg_namespace n ON n.oid = c.relnamespace
                                 WHERE relkind = 'r'
                             ) a
                         ) a order by  total_bytes desc
                         limit 10
                      """):
          print(record)
print(sql)
dat = pd.read_sql_query(sql, conn)
</code>
++++

++++ Python.date_time_tuple |
<code PYTHON>
import email.utils
import datetime

date_tuple=email.utils.parsedate_tz('Fri, 20 Jul 2007 15:31:21 +0400')
date=datetime.datetime.fromtimestamp(email.utils.mktime_tz(date_tuple))


import email.utils
import datetime
 
try:
    date_tuple=email.utils.parsedate_tz('Fri, 20 Jul 2007 15:31:21 +0400')
    date_v=datetime.datetime.fromtimestamp(email.utils.mktime_tz(date_tuple)
    date_str=date_v.strftime('%Y-%m-%d %H:%M')
except:
    date_str="1900-01-01 00:00"
   
from_str=email.utils.parseaddr(getHeader(headers,u'From'))[1]
</code>
++++

==== Python request Cookie example  ====

<code PYTHON>
#https://stackoverflow.com/questions/13030095/how-to-save-requests-python-cookies-to-a-file
from http.cookiejar import MozillaCookieJar
import requests

s = requests.Session()
s.cookies = MozillaCookieJar('cookies.txt')
# or s.cookies = MozillaCookieJar() and later use s.cookies.filename = 'cookies.txt' or pass the file name to save method.

response = s.get('https://www.msn.com')

s.cookies.save()
</code>

==== Python library ====
  * https://habr.com/ru/company/cloud4y/blog/650357/ - 30 лучших проектов python

==== Python linter best practice ====
  * самые распространенные ошибки https://habr.com/ru/company/breakpoint/blog/686104/ 
  * правила написания кода https://github.com/best-doctor/guides/blob/master/guides/python_styleguide.md



==== Python puenv virtualenv ====
https://realpython.com/intro-to-pyenv/
++++ Python.pyenv virtualenv |
Install multiple versions and library independence 
  * https://dev.to/macdub/pyenv-multiple-users-and-a-plugin-solution-3k16
  * https://github.com/pyenv/pyenv
  * https://github.com/macdub/pyenv-multiuser

<code PYTHON>
# .bashrc
export PYENV_ROOT="/home/melnikov_ea/.pyenv"
export PATH="$PYENV_ROOT/bin:$PATH"
export PIPENV_PYTHON="$PYENV_ROOT/shims/python"

eval "$(pyenv init -)"
eval "$(pyenv virtualenv-init -)"
export PYENV_LOCAL_SHIM=/home/melnikov_ea/.pyenv_local_shim

export PYENV_LOCAL_SHIM="$HOME/.pyenv_local_shim"
export PATH="$PYENV_LOCAL_SHIM:$HOME/.pyenv/bin:$PATH"
eval "$(pyenv virtualenv-init -)"
</code>
++++
==== Python Docker ====
  * multistage and health https://gabnotes.org/lighten-your-python-image-docker-multi-stage-builds/
  * wheels in python multistage https://morioh.com/p/d777482dea93


==== Python. Flask  ====
  * flask to start https://www.codementor.io/@chirilovadrian360/flask-tutorial-the-interactive-way-ask-me-anything-1evuou00by
  * flask in docker https://testdriven.io/blog/dockerizing-flask-with-postgres-gunicorn-and-nginx/
==== Python. Data visualization ====
  * [[https://proglib.io/p/tutorial-vizualizaciya-dannyh-v-vebe-s-pomoshchyu-python-i-dash-2021-01-11|визуализация данных в вебе с помощью Python и Dash]]
  * https://jupyter.brynmawr.edu/services/public/dblank/jupyter.cs/Jupyter%20Visualizations.ipynb#6.1-Google-Spreadsheets
  * plotly great example - analyze data - https://medium.com/plotly/introducing-dash-5ecf7191b503
  * python dash https://medium.com/plotly/introducing-dash-5ecf7191b503
  * https://towardsdatascience.com/a-simple-guide-to-beautiful-visualizations-in-python-f564e6b9d392  https://towardsdatascience.com/making-matplotlib-beautiful-by-default-d0d41e3534fd 
  * https://towardsdatascience.com/avatar-meets-data-visualization-60631f86ba7d https://medium.com/trymito/use-plotly-for-smarter-python-d449476b3fad
  * dash filter example https://gist.github.com/chriddyp/9b2b3e8a6c67697279d3724dce5dab3c
  * dash in 20 minutes https://dash.plotly.com/tutorial 

==== Python.Diagram ====
  * Diagram as a code - https://blog.bytebytego.com/p/diagram-as-code

===== Grafana =====
  * export image on curl https://lovethepenguin.com/grafana-how-to-export-graphs-as-images-and-email-them-4ef90689a5fa
  * grafana export graph to png with curl https://community.grafana.com/t/programatically-export-images-png-jpg-of-grafana-dashboard/15780

===== Git =====

  * Коммиты — это снимки, а не различия / Блог ... - Habr - https://habr.com/ru/company/skillfactory/blog/551848/ 
  * Git tree <code> git log --graph --pretty=format:'%C(yellow)%h%C(cyan)%d%Creset %s %C(white)- %an, %ar%Creset' </code>

===== OS development =====
  * Osdev https://wiki.osdev.org/Main_Page

===== DB development =====
https://github.com/ayende/libgavran/blob/master/intro/intro.adoc \\
https://ravendb.net/articles/re-are-you-sure-you-want-to-use-mmap-in-your-database-management-system \\