Search This Blog

How To Dev

A website sharing content on various technologies such as React, Angular, NodeJS, JavaScript, TypeScript, Golang, Python, PostgreSQL, MySQL, DevOps, Docker, K8s, Git, AWS, GCP and more.

Posts

Showing posts with the label n+1

Show all

No results found

Powered by Blogger

Theme images by Michael Elkan

AWS Practice Series

Introduction AWS (Amazon Web Services) is the world’s most comprehensive and broadly adopted cloud platform. It offers over 200 fully featured services from data centers globally. Instead of building and maintaining your own physical servers, you can simply "rent" resources from AWS and pay only for what you actually use. Explore Key Advantages Cost Savings: With the "Pay-as-you-go" model, you don't need a massive upfront investment in hardware. You only pay for the resources you consume. Scalability: You can instantly increase or decrease resources (like CPU, RAM, or storage) based on your real-time traffic. Security & Reliability: AWS meets strict international security standards (ISO, PCI DSS, etc.). Their global infrastructure ensures your system stays up and running 24/7. Massive Ecosystem: It provides everything from basic tools (servers, storage) to advanced tech (AI, Machine Learning, and IoT). When Should You Use It? Startups: Perfect for launching ...

WRITE-BEHIND

Introduction This article will guide you through implementing WRITE-BEHIND (WRITE-BACK) in NestJS with Redis and Postgres . Applying this mechanism will perform asynchronous writes to the Database via a Queue, so I will also use @nestjs/bullmq (BullMQ + Redis) , which is a standardized, powerful library for managing background jobs. As for theoretical content, you can review the previous article I mentioned. Detail Please install the following packages: bun add bullmq @nestjs/bullmq Create Drizzle Schema in drizzle-orm/schema/schema.ts as follows: import { bigserial, decimal, integer, pgTable, serial, text, timestamp, varchar, } from 'drizzle-orm/pg-core' export const products = pgTable ( 'products' , { id : bigserial ( 'id' , { mode : 'number' }). primaryKey (), name : varchar ( 'name' , { length : 255 }). notNull (), description : text ( 'description' ), price : decimal ( 'price' , { precision ...

Optimizing Konva Performance with Layer Caching and Tiling

Introduction In previous articles, I have guided you on using Viewport Culling and requestAnimationFrame to improve performance when using Konva to render 1,000 elements. Now, we will continue to improve further with Layer Caching and Tiling techniques to handle up to 10,000 elements. Prerequisites This article is extended from my previous articles, so please review the previous articles to grasp the necessary information before continuing. Detail Update file type.ts import type {GroupConfig} from 'konva/lib/Group' export interface ShapeData { id : string type : string x : number y : number size : number color : string } export interface ViewRect { x1 : number y1 : number x2 : number y2 : number } export interface ShapeItemProps extends GroupConfig { item : ShapeData image ?: HTMLImageElement onClick : ( id : string ) => void } export interface TileProps { items : ShapeData [] image : HTMLImageElement | undefined isZoomedOu...

Using Kubernetes Ingress to navigate traffic to Services

Introduction In the previous article, I introduced the basic concepts of Kubernetes Ingress , and how to use Ingress along with related components ( Nginx Ingress Controller and cert-manager ) to automatically issue TLS certificates when deploying HTTPS applications . In this article, I'll show you how to define rules in Ingress to route traffic to different Services based on your needs. Prepare Docker Image First, you'll need a Docker image to get started. You can either use two different Docker images or follow my next instructions to prepare a Docker image . Here's a code block to create a NodeJS server that displays a title based on an environment variable input: import express from 'express' const port = 3000 const title = 'This is NodeJS Typescript Application' const app = express () app . get ( '/' , ( _ , res ) => { res . send (( process ?. env ?. TITLE ?? title ) + '! Current time is ' + Date . now ()) ...

NestJS Practice Series

Introduction NestJS is a progressive NodeJS framework designed for building efficient, reliable, and scalable server-side applications. Built on top of TypeScript (but also supporting pure JavaScript), NestJS combines elements of Object-Oriented Programming (OOP), Functional Programming (FP), and Functional Reactive Programming (FRP). The outstanding advantages of NestJS include: Modular architecture: Helps organize code scientifically, easy to maintain and expand for large projects. Powerful TypeScript support: Fully leverage static typing to minimize errors during development. Flexibility: Allows easy integration with other libraries (like Express or Fastify) and supports a wide variety of communication protocols (REST, GraphQL, WebSockets, Microservices). Rich ecosystem: Provides ready-to-use tools for processing common tasks like Validation, Caching, Database mapping (TypeORM/Prisma), and Authentication. Dependency Injection: A powerful mechanism that helps manage...

Practicing with Google Cloud Platform - Google Kubernetes Engine to deploy nginx

Introduction This article provides simple step-by-step instructions for those who are new to Google Cloud Platform (GCP) and Google Kubernetes Engine (GKE) . I'll guide you through using GKE to create clusters and deploy nginx . The instructions below will primarily use gcloud and kubectl to initialize the cluster, which is more convenient than manual management on the Google Cloud interface. Prerequisites First, you need to prepare the following: Have a GCP account with permission to use Cloud services. If you're new, you'll get a $300 free trial to use for 90 days . Create a new GCP project. Enable Compute Engine and Kubernetes Engine services. Install Google Cloud SDK and kubectl For this installation step, refer to the GCP documentation for instructions tailored to your operating system. Once installed, execute the following commands to check if gcloud and kubectl are installed: gcloud version kubectl version If you see the version resul...

Sitemap

A page aggregator designed for easy reference and search, compiling all blog posts for convenient access. Loading all posts...

All Practice Series

Introduction This is a comprehensive page about the technologies I have shared in series format. You can view brief introductions and links to directly access each series you are interested in. In the field of software development, to deploy a product from the initial idea to its release, the standard process typically involves several stages as follows: Database : Designing and implementing the database according to business requirements, storing data during the system's operation. Backend : Handling the main logic of the system, communicating with the database and services. Frontend : Building the interface for users to interact with the system, which could be a desktop, mobile, or web application. This usually includes implementing UI/UX and integrating APIs from the backend. DevOps : Deploying the system for use, which can be done on a server or in the cloud. Testing : Applying testing methods to ensure the product meets the standards for release. Of course, these are just stan...

Guide to deploying NextJS on AWS ECS

Introduction I already have an article guiding the deployment of a project using the NestJS framework on AWS ECS, while in this article we will go through how to deploy a frontend project using the NextJS framework also deploying on AWS ECS, the difference is mostly concentrated in building the docker image, as long as you can build the docker image and push successfully to AWS ECR, the next steps are almost identical Prerequisites Because there was a previous article providing quite comprehensive guidance on AWS ECS, in this article I might not instruct in detail about it much more, if there is any information that is not clear you can review previous articles to understand better The goal of the article is to concentrate on the deployment so I will not dive deep into coding NextJS but will reuse from previous articles, you can also use a similar project according to your own needs Detail First of all, let's update the next.config.ts file to support standalone mode import type {...

Using CROSS JOIN LATERAL in Postgres

Introduction In standard SQL, subqueries located in the JOIN clause operate independently, they cannot see or use data from tables located before (to the left of) it. When you add the LATERAL keyword, Postgres allows the subquery on the right to directly access column values of each row in the table on the left. Differences between Join types are as follows Standard CROSS JOIN takes the Cartesian product of 2 tables independent of each other (a multiplication of 2 tables without needing a condition) CROSS JOIN LATERAL operates like a for-each loop in programming, with each row in the left table, Postgres runs the subquery on the right to perform dynamic calculations repeatedly based on values from the left table and joins the results together. INNER JOIN is the intersection between 2 datasets, it only retains rows in 2 tables when both satisfy a specific join condition, the condition in ON is mandatory (unlike CROSS JOIN which does not require passing a condition) Can be combined...

Labels

devops87 typescript82 postgresql68 javascript58 backend43 nestjs42 nextjs40 database39 docker39 cloud38

software engineering38 aws36 aws cdk28 nodejs28 sql27 web development27 react25 gcp24 postgres24 Kubernete21 deploy21 database optimization20 gcloud20 performance19 security19 frontend18 kubectl18 backend development13 s313 api12 indexing12 caching11 microservices11 optimization11 ci/cd9 gke9 orm9 automation8 cicd8 cloudfront8 database performance8 graphql8 k8s8 query planner8 redis8 typesript8 drizzle7 frontend development7 prisma7 serverless7 sql optimization7 bucket6 cache6 cluster6 concurrency control6 design6 ecr6 gin index6 iam6 kind6 validation6 angular5 authentication5 crud5 deployment5 google cloud5 hash join5 konva5 nginx5 nosql5 performance optimization5 proxy5 query optimization5 query tuning5 relational database5 seo5 sql performance5 ssr5 api security4 b-tree4 b-tree index4 cloud computing4 composite index4 cte4 database design4 dead tuples4 express4 golang4 grafana4 index only scan4 index scan4 jwt4 materialized view4 merge join4 middleware4 performance tuning4 plpgsql4 programming4 python4 query performance4 tutorial4 web performance4 acid3 ant design3 app router3 autovacuum3 cache-aside3 canvas3 client components3 cybersecurity3 data visualization3 database indexing3 database security3 development3 docker compose3 docker-compose3 ecs3 engineering3 explain analyze3 fargate3 fastify3 full-text search3 gitlab3 google cloud run3 grpc3 helm3 jsonb3 low latency3 micro-frontend3 minio3 monitor3 msw3 mvcc3 nested loop join3 node.js3 oop3 postgresql optimization3 prometheus3 query3 read-through3 real-time data3 scalability3 secret3 seq scan3 server components3 ssh3 sso3 storage3 swagger3 system3 terraform3 testing3 toast3 typeorm3 types3 unit testing3 valkey3 vite3 web3 web security3 write-through3 zustand3 SQL2 advisory lock2 ai2 analytics2 api gateway2 architecture2 async2 authorization2 auto scale2 aws cli2 aws ecr2 aws ecs2 backend engineering2 blacklist2 brin index2 bullmq2 cAdvisor2 candlestick chart2 canvas performance2 cdn2 check constraint2 citus2 clauses2 cloud function2 cls2 coding2 compute engine2 concurrency2 connection pooler2 containerization2 cookie2 core web vitals2 csrf2 data2 data integrity2 database engineering2 database lock2 database scaling2 database seeding2 database transactions2 databases2 dependency management2 distributed database2 distributed system2 dto2 dynamic rendering2 dynamic routes2 dynamodb2 e2e testing2 exclusion constraint2 execution plan2 expression index2 for update2 framework2 frontend testing2 fullstack2 function2 google bucket2 google cloud build2 google cloud engine2 google cloud function2 google cloud storage2 hash index2 hash partitioning2 heap scan2 high availability2 high performance2 html2 http2 immer2 index2 index optimization2 ingress2 ingress controller2 inner join2 integration test2 integration testing2 isr2 jenkins2 kafka2 kubernetes2 lcp2 left join2 list partitioning2 localstorage2 lock modes2 main thread2 module federation2 monitoring2 nested loop2 nested query2 next2 normalization2 object2 openapi2 overhead2 pagination2 partial index2 patterns2 pgbouncer2 pipeline2 pod2 postgres vacuum2 posting list2 pothos2 primary key2 range partitioning2 rate limit2 rds2 react fiber2 react hooks2 react testing library2 react-konva2 react-query2 reactjs2 reconciliation2 rendering2 requestanimationframe2 resizeobserver2 rest2 restful2 reverse proxy2 rewrites2 samesite2 sequential scan2 server actions2 server-sent events2 service2 sharding2 snaplet seed2 software2 software testing2 sql tuning2 ssg2 ssm2 stale-while-revalidate2 standalone2 state management2 static site generation2 stored procedure2 strategies2 strategy2 subquery2 table2 table bloat2 table partitioning2 tdd2 test automation2 text2 type-safe2 unique index2 unit test2 usedeferredvalue2 uuid2 viewport culling2 virtualization2 vitest2 vm instance2 waf2 web dev2 window functions2 work_mem2 write-around2 write-behind2 xss2 zod2 1nf1 2d graphics1 2nf1 3nf1 access control1 access share1 access token1 adapter1 advantages1 aggregate constraint1 aggregate filter1 aggregate functions1 ahead1 ai agent1 ai chatbot1 alpine1 amplify1 analysis1 analyze1 analyze command1 ansible1 anti join1 anti-attack1 anti-semi-join1 anti-spam1 apache superset1 api protection1 api route1 api routes1 api simulation1 api testing1 api validation1 apollo client1 apollo server1 apollo-sandbox1 apollo-server1 app runner1 apple silicon1 application architecture1 array datatype1 artificial intelligence1 asc desc indexing1 asitop1 aspect ratio1 assignment cast1 ast1 asynchronous1 asynchronous rendering1 auditing1 auto analyze1 auto-vacuum1 automation tool1 avif1 await1 aws eks1 aws lambda1 aws s31 backend integration1 batch processing1 batching1 bcnf1 behavioral1 bernoulli1 bff1 bi-directional1 big data1 bigint1 binary1 bitmap index scan1 bitmap scan1 block range index1 boilerplate1 boolean1 broadcasting1 browser automation1 btree1 btree index1 bufbuild1 build phase1 bulk insert1 bun1 business logic1 bytea1 cache-control1 cache-manager1 callback url1 canvas api1 cap theorem1 capacity1 cdk1 cert-manager1 chain of thought1 char1 character1 chart1 charts1 check1 ci/cd security1 class-validator1 client-side rendering1 cloud database1 cloud databases1 cloud storage1 cloud-native1 cloudfare1 cloudwatch1 code analysis1 code stability1 code-first1 coding tips1 coding tutorials1 collection1 columns1 commit1 common table expression1 common table expressions1 component test1 compression1 concurrent rendering1 conditional logic1 configmap1 configuration1 connect-rpc1 connection limit1 connection overhead1 connection pool1 connection pool security1 connectrpc1 const1 constraint1 container image1 continuous delivery1 continuous integration1 contract testing1 controller1 coordinate transformation1 correlated subqueries1 correlated subquery1 cors1 cost model1 cost-based optimizer1 coverage1 covering index1 create role1 creational1 cross join lateral1 cross-platform1 cross-site request forgery1 crosstab1 crud api1 crypto dashboard1 csp1 csr1 csrf protection1 cube1 culling1 cumulative layout shift1 cursor1 custom-hook1 d31 d3.js1 d3.js canvas1 data aggregation1 data analysis1 data analysist1 data anomalies1 data bloat1 data mutation1 data storage1 data structures1 data transformation1 data types1 data validation1 data-fetching1 database access control1 database administration1 database conflict matrix1 database connection1 database engine1 database integrity1 database locking1 database maintenance1 database management1 database operations1 database protection1 database query tuning1 database relationships1 database replication1 database reporting1 database testing1 database transaction1 database tuning1 dataloader1 datatypes1 date1 date_trunc1 db performance1 ddl1 debouncing1 declarative1 deletion anomaly1 denormalization1 dependency injection1 design pattern1 dev environment1 developer1 developer tools1 devtools1 diagram1 dirty read1 disk1 distinct on1 distributed caching1 distributed systems1 dml1 docker build1 dockerfile1 document api1 documentation1 dom1 domain integrity1 dompurify1 double1 dpr1 drag and drop1 drawing app1 drizzle-kit1 drizzle-orm1 dynamic import1 dynamic indexing1 dynamic policies1 eager1 ec21 ecommerce1 ecommerce architecture1 ecommerce schema1 efficient1 eks1 elixir1 encapsulation1 enterprise app1 entity integrity1 environment management1 error1 error boundary1 error handling1 estimation1 etag1 etcd1 event handling1 event-based1 except1 exception filters1 exceptions handling1 exclusive lock1 exclusivestartkey1 exists1 experience1 explicit cast1 explicit locking1 extended1 external1 facade1 factory1 failover1 faker js1 faker.js1 fast-csv1 fast-gateway1 fault tolerance1 fetch api1 fetch first1 ffmpeg1 file upload1 filter where1 filtering clauses1 filters1 finance system1 fintech1 firebase1 flask1 float1 float32array1 flushSync1 folder-based routing1 for share1 foreign key1 form handling1 four1 fp1 fps1 free host1 freeze1 front-end performance1 frontend performance1 frontend security1 frp1 function url1 functions1 gae1 gang1 garbage1 general-purpose1 generated1 geometric data1 geometric types1 geqo1 gist1 gist index1 gist vs sp-gist1 github1 global error1 global secondary index1 go1 gof1 goroutine1 gpu1 gpu optimization1 grant permissions1 graphql-codegen1 graphql-depth-limit1 graphql-request1 group by extensions1 groupaggregate1 grouping clauses1 grouping sets1 gsi1 guards1 guide1 handlers1 handling1 haproxy1 hash collision1 hash semi join1 hash table1 hash-based sharding1 hashaggregate1 hashids1 having clause1 header1 headers1 health check1 heap1 heap page1 heap storage1 high cardinality1 high priority1 high-level1 hld1 hmac1 horizontal partitioning1 hpa1 http headers1 http/21 http21 httponly1 https1 huggingface1 human error1 hydration1 id encoding1 identity provider1 image export1 image optimization1 images1 imgproxy1 immutable1 implicit cast1 improve performance1 in clause1 in-memory1 include clause1 incremental static regeneration1 index overhead1 index performance1 index tuning1 indexeddb1 indexing strategy1 infrastructure1 infrastructure as code1 inp1 insertion anomaly1 installation1 installation guide1 integer1 integration1 interactivity1 intercepting routes1 interceptors1 intermediate result1 internal mechanics1 intersect1 interval1 introduction1 ioredis1 ip whitelist1 iso1 isolation levels1 it1 javascript runtime1 javascript testing1 jcasc1 jest1 jest config1 join1 join multiple tables1 join optimization1 joins1 jsdom1 json1 json export1 json querying1 json web token1 jsonb casting1 jsonb querying1 jsonb_ops1 jsonb_path_ops1 key management service1 keycloak1 keyset pagination1 kms1 kubernetes dashboard1 lambda1 lastevaluatedkey1 layering1 lazy loading1 least privilege1 libraries1 lightsail1 limit1 limiting1 line chart1 linux memory1 live tuples1 lld1 llm inference1 load balancer1 load balancing1 loadbalancer1 loading1 local llm1 lock1 lock matrix1 logs1 loki1 lost update1 lower1 lru-cache1 lz41 mac1 machine learning1 main1 many to many1 markdown1 materialized view count1 max limit1 mc1 mcv1 md51 memoization1 memory1 memory overhead1 merge1 merge phase1 merge semi join1 mermaid1 message broker1 metadata xml1 method1 methods1 mfa1 microsoft entra1 microsoft playwright1 migration1 minio client1 mlx-lm1 mock api1 mock data1 mocking1 modular architecture1 moleculer1 mongodb1 multi-column in1 multi-stage build1 multi-tenant security1 multi-threading1 multiple columns1 n+11 native1 nestjs testing1 network layer1 next.config.ts1 nextjs 131 nextjs 141 nextjs app router1 nextjs image1 nextjs tutorial1 node.js interception1 non-repeatable read1 nonce1 normal forms1 not exists1 not found1 not in1 npm audit1 nrwl1 null1 null handling1 numeric1 nx1 obfuscation1 object storage1 observer1 of1 offscreen canvas1 offset1 olap1 olap reporting1 oltp1 on conflict1 on-demand1 on-demand revalidation1 one to many1 one to one1 oom killer1 open source1 open source security1 open-source1 optimistic1 optimistic locking1 order by1 order by nulls last1 origin1 out parameters1 package manager1 package security1 packages1 pact1 page1 page layout1 page limit1 pages_per_range1 paint application1 parallel fetching1 parallel routes1 partial prerendering1 partition pruning1 partitioning1 partitions1 passport-saml1 password hashing1 patroni1 payload limit1 performance test1 persistent1 pessimistic locking1 pg-promise1 pg_cast1 pg_class reltuples1 pg_trgm1 pgcrypto1 pglz1 pipes1 pivot1 plain1 playwright1 poetry1 poetry.lock1 polymorphic relationship1 postgis1 postgres index1 postgres performance1 postgresql b-tree1 postgresql count1 postgresql indexing1 postgresql rls1 postgresql triggers1 postgresql tuning1 postman1 ppr1 practice1 precision1 prefetching1 prefix search1 preflight1 prepared statements1 presigned urls1 principles1 prisma-client1 probe phase1 problem1 productivity1 progressive enhancement1 promise1 protobuf1 protocol buffers1 proxy server1 pub/sub1 pure component1 pyenv1 pyproject.toml1 python versions1 qa1 quality improvement1 quantization1 queries1 query execution order1 query planner cost model1 query routing1 querycommand1 queue1 qwen1 race condition1 raf1 ram1 random io1 range types1 rate1 rate limiting1 rbac1 rdbms1 react konva1 react query1 react suspense1 react.memo1 read committed1 read replicas1 readable syntax1 real dom1 real-time communication1 recursive query1 redirects1 redis cluster1 redux devtools1 referential integrity1 referer1 refresh1 refresh concurrently1 refresh-ahead1 relational database schema1 relational model1 rendering methods1 rendering optimization1 rendering pipeline1 repeatable read1 request-response1 requirement1 resolution1 responsive images1 rest api1 restful api1 returning1 revalidate1 revalidatepath1 reverse1 reverse-proxy1 revoke permissions1 rich text1 role anywhere1 role assignment1 rollback1 rollup1 route handlers1 routing landmark1 row exclusive1 row level lock1 row lock1 row share1 row-level locks1 row-level security1 rpc1 s3 api1 s3 sdk1 saas data isolation1 saml21 sanitization1 savepoint1 scale out1 scale up1 scale-out1 scan1 scheduling1 schema1 seal1 security audit1 security definer1 security invoker1 seeding1 selection1 selection clauses1 self referencing1 semi join1 semi-join1 serial1 serializable1 series1 server1 server component1 server side rendering1 server-side rendering1 server-side routing1 service provider1 service worker1 session mode1 sessionstorage1 setup1 share update exclusive1 shared buffers1 shared lock1 shared_buffers1 sharp1 simplified1 single sign-on1 single-flight mutation1 singleton1 skeleton screens1 skew bucket1 skip locked1 snapshot1 sns1 snyk1 socketio1 software architecture1 software-engineering1 solid1 sort phase1 sp-gist index1 space partitioning1 speed1 sql clauses1 sql injection mitigation1 sql join types1 sql joining order1 sql precedence1 sql procedure1 sql query1 sql rewrite1 sql server1 sql tips1 sql triggers1 sqs1 sse1 stack1 standard view1 state-of-the-art1 statements1 storage strategies1 store.ts1 stored1 stored procedures1 strategic denormalization1 streaming1 streaming data1 string1 structural1 styled-component1 sub partitioning1 sub-partitioning1 subtransactions1 supabase1 supavisor1 supertest1 suspense1 svg1 svg vs canvas1 synchronous1 syntax1 table lock1 table locks1 table-level locks1 tablefunc1 tablesample1 tech1 technical translation1 temporal database1 temporary table1 test coverage1 test-driven development1 testing library1 testing tools1 text editor1 throttling1 tiling1 time1 time-based revalidation1 timestamp1 timestamptz1 timetz1 tinymce1 tls certificate1 to1 to_tsvector1 token1 token revocation1 tokenization1 transaction control1 transaction isolation1 transaction level lock1 transaction mode1 transactional isolation1 transactions1 transferable objects1 transform1 trigger1 trigger function1 triggers1 trigram1 trigram search1 troubleshooting1 tuning1 tuple comparison1 type casting1 type hierarchy1 type.ts1 ubuntu1 ui responsiveness1 unbalanced trees1 unified memory1 union all1 unique id1 unnest1 update1 update anomaly1 upload1 upsert1 use-deferred-value1 use-transition1 user creation1 user defined function1 usetransition1 using clause1 using group by1 uuid alternative1 uuidv71 vacuum1 vacuum full1 vacuum overhead1 varchar1 varlena1 vercel1 versioning1 virtual dom1 virtual environment1 virtual scroll1 visibility api1 visibility map1 vpc1 vulnerabilities1 vulnerability scanning1 wal1 wal log1 web development.1 web engineering1 web server1 web vitals1 web worker1 web workers1 web-development1 webhook1 webp1 webpack1 websocket1 websockets1 whitebaord1 whiteboard1 window function1 write skew1 write-ahead logging1 write-back1 xml1 xss prevention1 yarn audit1 yoga1 zero copy1 zero downtime1 zig1 zones1

Show more Show less