installing Scrapy in shared server environment

installing Scrapy in shared server environment as easy as below
you only need to define install directory

easy_install --install-dir=/home/py/www/programs/ -U Scrapy

Comments

Post a Comment

Popular posts from this blog

How to add pagination to django comments for your model

First step is import Comment and ContentType to your view like below from django.contrib.comments.models import Comment from django.contrib.contenttypes.models import ContentType Second step is defining your model which you want to paginate its comments content_type_id= ContentType.objects.get_for_model( YOUR_MODEL_NAME ) Last get comments of specific instance of your model class with defining object_pk as filter parameter comments = Comment.objects.filter(content_type=content_type_id,object_pk=quote_id) here is complete view code from django.core.paginator import Paginator, InvalidPage, EmptyPage from django.contrib.comments.models import Comment from django.contrib.contenttypes.models import ContentType def quote_show_page(request,quote_id): quote = get_object_or_404(Quote, id=quote_id) content_type_id=ContentType.objects.get_for_model(Quote) comments = Comment.objects.filter(content_type=content_type_id,object_pk=quote_id) paginator = Paginator(comments, 5) # Show 5 comments pe...
Read more

overlay filesystem and containers

Containers A  container  is a process running on the host system.  This process is started by the container runtime from a container image, and the runtime provides a set of tools to manage the container process.  Namespaces virtualize the container process’s PID, network, root, and users.  Cgroups help set resource usage limits the container process can consume on the host system, and security contexts enforce permissions the container process has on the host system. A container, as a runtime object, consumes the typical resources any running process would consume on a system: storage for the file system and any saved configuration files, CPU, memory, and networking to serve traffic to/from external clients, and other containers or devices on the system. docker run container from image and connect it with shell , install necessary networking tools docker run -d -it ubuntu:22.10 bash docker run -d -it --privileged ubuntu:22.10 bash -> if you need to write to...
Read more

Django project and Perfect setup of nginx config for www to nonwww and http to https and ip to domain redirects

Here I am sharing good setup of nginx config for following requirements. before following config you need to create 2 A record for both domain to ip and www.domain to ip in your dns provider. also for django settings file you can add domain and www.domain to ALLOWED_HOSTS http to https www to nonwww https://ip to domain http://ip to domain redirects place following config to your sites-enabled config file server {   listen 80;   listen 443 ssl;   server_name yourserverip;   ssl_certificate /home/yourdomain.com.crt;   ssl_certificate_key /home/yourdomain.com.key;   add_header X-Frame-Options "SAMEORIGIN";   return 301 https://yourdomain.com$request_uri; } server {     listen 443 ssl;     server_name yourdomain.com;     ssl_certificate /home/yourdomain.com.crt;     ssl_certificate_key /home/yourdomain.com.key;     ssl_protocols TLSv1.2 TLSv1.1 TLSv1;     ssl_prefer_server_ciphers on;   ...
Read more