2023-04-17 19:30:48.468 +03:00 [INF] Start ScraperEngine.RunAsync
2023-04-17 19:30:48.468 +03:00 [INF] Application started. Press Ctrl+C to shut down.
2023-04-17 19:30:48.515 +03:00 [INF] Hosting environment: Development
2023-04-17 19:30:48.516 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:30:48.516 +03:00 [INF] Content root path: C:\Projects\WebReaper\Examples\WebReaper.ScraperWorkerService
2023-04-17 19:30:48.517 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:30:48.520 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:30:48.526 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:30:48.571 +03:00 [INF] Scheduling the initial scraping job with start url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:30:48.573 +03:00 [INF] Start RedisScheduler.AddAsync
2023-04-17 19:30:48.582 +03:00 [INF] Start consuming the scraping jobs
2023-04-17 19:30:48.585 +03:00 [INF] Start RedisScheduler.GetAllAsync
2023-04-17 19:30:48.592 +03:00 [INF] Start crawling url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:30:48.628 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:30:48.629 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:30:48.631 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:30:48.633 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:30:48.641 +03:00 [INF] Loading static page https://rutracker.org/forum/index.php?c=33
2023-04-17 19:30:50.780 +03:00 [INF] Load finished in 2135 ms
2023-04-17 19:43:09.205 +03:00 [INF] Start ScraperEngine.RunAsync
2023-04-17 19:43:09.205 +03:00 [INF] Application started. Press Ctrl+C to shut down.
2023-04-17 19:43:09.251 +03:00 [INF] Hosting environment: Development
2023-04-17 19:43:09.252 +03:00 [INF] Content root path: C:\Projects\WebReaper\Examples\WebReaper.ScraperWorkerService
2023-04-17 19:43:09.253 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:09.254 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:09.256 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:09.261 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:09.306 +03:00 [INF] Scheduling the initial scraping job with start url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:43:09.309 +03:00 [INF] Start RedisScheduler.AddAsync
2023-04-17 19:43:09.318 +03:00 [INF] Start consuming the scraping jobs
2023-04-17 19:43:09.322 +03:00 [INF] Start RedisScheduler.GetAllAsync
2023-04-17 19:43:09.328 +03:00 [INF] Start crawling url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:43:09.346 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:09.347 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:09.349 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:09.351 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:09.357 +03:00 [INF] Loading static page https://rutracker.org/forum/index.php?c=33
2023-04-17 19:43:11.281 +03:00 [INF] Load finished in 1918 ms
2023-04-17 19:43:11.554 +03:00 [INF] Received 6 new jobs
2023-04-17 19:43:11.556 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:43:11.831 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:43:11.832 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:43:11.832 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:43:11.832 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:43:11.832 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:11.833 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:11.833 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:43:11.834 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:43:11.834 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:11.835 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:11.836 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:11.837 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:11.838 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:11.839 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:11.840 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:11.841 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:11.842 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:11.843 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:11.844 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:11.845 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:11.848 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:11.849 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:11.850 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:11.851 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:11.852 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:11.853 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:11.855 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:11.856 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:11.858 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:43:11.858 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:43:11.859 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:11.860 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:11.862 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:43:11.866 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:43:11.869 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:43:11.870 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:43:12.635 +03:00 [INF] Load finished in 764 ms
2023-04-17 19:43:12.636 +03:00 [INF] Load finished in 768 ms
2023-04-17 19:43:12.638 +03:00 [INF] Load finished in 765 ms
2023-04-17 19:43:12.651 +03:00 [INF] Received 4 new jobs
2023-04-17 19:43:12.653 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:43:12.655 +03:00 [INF] Received 4 new jobs
2023-04-17 19:43:12.655 +03:00 [INF] Load finished in 781 ms
2023-04-17 19:43:12.656 +03:00 [INF] Received 8 new jobs
2023-04-17 19:43:12.656 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:43:12.658 +03:00 [INF] Start RedisScheduler.AddAsync with 8 jobs
2023-04-17 19:43:12.661 +03:00 [INF] Received 6 new jobs
2023-04-17 19:43:12.663 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:43:12.761 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:43:12.761 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:43:12.762 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:43:12.762 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:43:12.762 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:43:12.762 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.762 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:43:12.762 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:43:12.763 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:43:12.763 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:43:12.763 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.764 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:43:12.764 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:43:12.764 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:43:12.764 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.765 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:43:12.765 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:43:12.765 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:43:12.765 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.766 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:43:12.766 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.767 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.768 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.769 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.770 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.771 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.772 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.773 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.773 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.774 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.775 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.777 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.778 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.779 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.780 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.781 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.782 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.783 +03:00 [INF] Load finished in 917 ms
2023-04-17 19:43:12.784 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.785 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.786 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.786 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.788 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.788 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.789 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.790 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.794 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.795 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.796 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.797 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.798 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:43:12.800 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.801 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.803 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.804 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.805 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.806 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:43:12.809 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.810 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.811 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.812 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.813 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.814 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.815 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.817 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.817 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.819 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.819 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.820 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.821 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.822 +03:00 [INF] Received 5 new jobs
2023-04-17 19:43:12.824 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.825 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.827 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.828 +03:00 [INF] Load finished in 956 ms
2023-04-17 19:43:12.829 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.830 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.830 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.831 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.832 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.833 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.834 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.835 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.837 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.839 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:43:12.842 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.844 +03:00 [INF] Start RedisScheduler.AddAsync with 5 jobs
2023-04-17 19:43:12.845 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.845 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.846 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.848 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:43:12.849 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.850 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:43:12.851 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:43:12.851 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:43:12.852 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:43:12.852 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:43:12.854 +03:00 [INF] Received 3 new jobs
2023-04-17 19:43:12.857 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.857 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:43:12.858 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:43:12.859 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:43:12.861 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:43:12.862 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:43:12.863 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:43:12.864 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.865 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:43:12.870 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:43:12.872 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:43:12.873 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:43:12.878 +03:00 [INF] Start RedisScheduler.AddAsync with 3 jobs
2023-04-17 19:43:12.880 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.891 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.895 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.897 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:43:12.897 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:43:12.898 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:43:12.899 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.900 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:12.905 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.905 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:12.907 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.909 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:12.910 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:43:12.910 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:12.913 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:43:13.762 +03:00 [INF] Load finished in 887 ms
2023-04-17 19:43:13.778 +03:00 [INF] Load finished in 906 ms
2023-04-17 19:43:13.816 +03:00 [INF] Load finished in 931 ms
2023-04-17 19:43:13.816 +03:00 [INF] Load finished in 934 ms
2023-04-17 19:43:13.817 +03:00 [INF] Found 1 with pagination
2023-04-17 19:43:13.823 +03:00 [INF] Received 51 new jobs
2023-04-17 19:43:13.843 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:43:13.847 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:13.849 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:13.851 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:13.852 +03:00 [INF] Load finished in 967 ms
2023-04-17 19:43:13.854 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:43:13.856 +03:00 [INF] Load finished in 973 ms
2023-04-17 19:43:13.864 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:13.870 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:13.872 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:13.873 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:43:13.873 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:13.874 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:13.884 +03:00 [INF] Load finished in 990 ms
2023-04-17 19:43:13.885 +03:00 [INF] Load finished in 992 ms
2023-04-17 19:43:13.886 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:43:13.887 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:13.897 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:13.907 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:13.908 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:13.908 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:43:13.910 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:13.911 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:13.928 +03:00 [INF] Load finished in 1056 ms
2023-04-17 19:43:13.934 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=396
2023-04-17 19:43:13.935 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:13.935 +03:00 [INF] Load finished in 1077 ms
2023-04-17 19:43:13.935 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:13.938 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:13.971 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:13.971 +03:00 [INF] Load finished in 1097 ms
2023-04-17 19:43:13.971 +03:00 [INF] Load finished in 1106 ms
2023-04-17 19:43:13.973 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:13.976 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:14.003 +03:00 [INF] Load finished in 1121 ms
2023-04-17 19:43:14.003 +03:00 [INF] Load finished in 1125 ms
2023-04-17 19:43:14.004 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.005 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2322
2023-04-17 19:43:14.008 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.030 +03:00 [INF] Load finished in 1143 ms
2023-04-17 19:43:14.030 +03:00 [INF] Load finished in 1138 ms
2023-04-17 19:43:14.031 +03:00 [INF] Load finished in 1119 ms
2023-04-17 19:43:14.031 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.031 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.049 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.050 +03:00 [INF] Load finished in 1136 ms
2023-04-17 19:43:14.068 +03:00 [INF] Load finished in 1164 ms
2023-04-17 19:43:14.068 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.069 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.094 +03:00 [INF] Load finished in 1191 ms
2023-04-17 19:43:14.094 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.108 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.130 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.179 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.179 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.181 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:14.207 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.208 +03:00 [INF] Found 9 with pagination
2023-04-17 19:43:14.208 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:14.240 +03:00 [INF] Received 59 new jobs
2023-04-17 19:43:14.240 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2167
2023-04-17 19:43:14.241 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1993
2023-04-17 19:43:14.241 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2321
2023-04-17 19:43:14.278 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:43:14.279 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.280 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.301 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.328 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:43:14.330 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.345 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.345 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.346 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.361 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.361 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.362 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.363 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.436 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.365 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.413 +03:00 [INF] Found 8 with pagination
2023-04-17 19:43:14.415 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.415 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.433 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.433 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.434 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.435 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.435 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.468 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.469 +03:00 [INF] Found 9 with pagination
2023-04-17 19:43:14.483 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.485 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.491 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.493 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.493 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.493 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.508 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:14.510 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:14.511 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.512 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:14.512 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.512 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.513 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.514 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.515 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:14.516 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:14.520 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:14.520 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.525 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.525 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.526 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.526 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.526 +03:00 [INF] Received 58 new jobs
2023-04-17 19:43:14.526 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.526 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.526 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.526 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:14.527 +03:00 [INF] Received 59 new jobs
2023-04-17 19:43:14.527 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:43:14.528 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:43:14.529 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5272198
2023-04-17 19:43:14.530 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:14.533 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:43:14.533 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.535 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.536 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.538 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3697211
2023-04-17 19:43:14.538 +03:00 [INF] Start RedisScheduler.AddAsync with 58 jobs
2023-04-17 19:43:14.540 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.541 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.542 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.543 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:14.544 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:43:14.545 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.546 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.547 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.548 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1893006
2023-04-17 19:43:14.549 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4679421
2023-04-17 19:43:14.551 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5078896
2023-04-17 19:43:14.555 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5079613
2023-04-17 19:43:14.589 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.590 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.564 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5331018
2023-04-17 19:43:14.565 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4522062
2023-04-17 19:43:14.569 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=260614
2023-04-17 19:43:14.580 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1766404
2023-04-17 19:43:14.581 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.582 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5334991
2023-04-17 19:43:14.582 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.584 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3349864
2023-04-17 19:43:14.585 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.586 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.587 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.589 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.558 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.564 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4819114
2023-04-17 19:43:14.592 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.593 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.594 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4351857
2023-04-17 19:43:14.595 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.596 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.597 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.599 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4577280
2023-04-17 19:43:14.599 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.601 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.602 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.603 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.604 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.605 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.606 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.607 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.608 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.608 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.610 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.610 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.611 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.612 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.613 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.615 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.618 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:14.620 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.621 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.622 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.623 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.624 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.625 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.626 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.627 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.628 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.629 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.632 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5079613
2023-04-17 19:43:14.633 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.634 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.635 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.636 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.637 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.637 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:14.639 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:43:14.639 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.640 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:43:14.641 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.642 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5272198
2023-04-17 19:43:14.643 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.644 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.647 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.650 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.650 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.652 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.653 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.654 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.655 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.656 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.657 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:14.659 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.663 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.665 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1893006
2023-04-17 19:43:14.666 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4679421
2023-04-17 19:43:14.667 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5078896
2023-04-17 19:43:14.668 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3697211
2023-04-17 19:43:14.669 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.670 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5331018
2023-04-17 19:43:14.671 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.672 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4522062
2023-04-17 19:43:14.673 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=260614
2023-04-17 19:43:14.674 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1766404
2023-04-17 19:43:14.675 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:14.676 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5334991
2023-04-17 19:43:14.677 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3349864
2023-04-17 19:43:14.686 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4819114
2023-04-17 19:43:14.688 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4351857
2023-04-17 19:43:14.693 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4577280
2023-04-17 19:43:15.382 +03:00 [INF] Load finished in 731 ms
2023-04-17 19:43:15.383 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:43:15.391 +03:00 [INF] ProcessTargetPage was called 1 times
2023-04-17 19:43:15.391 +03:00 [INF] ProcessTargetPage was called 2 times
2023-04-17 19:43:15.392 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.393 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.394 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.395 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.396 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.397 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.398 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.399 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.405 +03:00 [INF] Load finished in 724 ms
2023-04-17 19:43:15.406 +03:00 [INF] ProcessTargetPage was called 3 times
2023-04-17 19:43:15.408 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.409 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.410 +03:00 [INF] Load finished in 722 ms
2023-04-17 19:43:15.410 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.412 +03:00 [INF] Load finished in 729 ms
2023-04-17 19:43:15.411 +03:00 [INF] ProcessTargetPage was called 4 times
2023-04-17 19:43:15.412 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.413 +03:00 [INF] ProcessTargetPage was called 5 times
2023-04-17 19:43:15.414 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.416 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.421 +03:00 [INF] Load finished in 722 ms
2023-04-17 19:43:15.421 +03:00 [INF] Load finished in 731 ms
2023-04-17 19:43:15.421 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.422 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.423 +03:00 [INF] ProcessTargetPage was called 6 times
2023-04-17 19:43:15.424 +03:00 [INF] ProcessTargetPage was called 7 times
2023-04-17 19:43:15.426 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.427 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.428 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.429 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.430 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.431 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.433 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.434 +03:00 [INF] Load finished in 750 ms
2023-04-17 19:43:15.434 +03:00 [INF] Load finished in 749 ms
2023-04-17 19:43:15.434 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.438 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.439 +03:00 [INF] ProcessTargetPage was called 8 times
2023-04-17 19:43:15.440 +03:00 [INF] ProcessTargetPage was called 9 times
2023-04-17 19:43:15.441 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.442 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.443 +03:00 [INF] Load finished in 742 ms
2023-04-17 19:43:15.443 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.445 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.446 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.448 +03:00 [INF] ProcessTargetPage was called 10 times
2023-04-17 19:43:15.452 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.454 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.456 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.457 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.459 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.460 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.461 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.462 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.463 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.467 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.490 +03:00 [INF] Load finished in 1579 ms
2023-04-17 19:43:15.502 +03:00 [INF] Load finished in 1605 ms
2023-04-17 19:43:15.518 +03:00 [INF] Found 7 with pagination
2023-04-17 19:43:15.532 +03:00 [INF] Received 57 new jobs
2023-04-17 19:43:15.533 +03:00 [INF] Start RedisScheduler.AddAsync with 57 jobs
2023-04-17 19:43:15.541 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:15.542 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3663750
2023-04-17 19:43:15.543 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:15.543 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.544 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:15.545 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.548 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.550 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.551 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3663750
2023-04-17 19:43:15.554 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6128227
2023-04-17 19:43:15.555 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.557 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.561 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.562 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.564 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6128227
2023-04-17 19:43:15.599 +03:00 [INF] Load finished in 907 ms
2023-04-17 19:43:15.599 +03:00 [INF] Load finished in 1049 ms
2023-04-17 19:43:15.601 +03:00 [INF] ProcessTargetPage was called 11 times
2023-04-17 19:43:15.611 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.612 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.613 +03:00 [INF] Load finished in 913 ms
2023-04-17 19:43:15.615 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.616 +03:00 [INF] ProcessTargetPage was called 12 times
2023-04-17 19:43:15.618 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.621 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.621 +03:00 [INF] Load finished in 925 ms
2023-04-17 19:43:15.623 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.625 +03:00 [INF] ProcessTargetPage was called 13 times
2023-04-17 19:43:15.633 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.634 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.637 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.639 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.642 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.653 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.656 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:15.658 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:15.659 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:15.670 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2074746
2023-04-17 19:43:15.671 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.673 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.674 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.676 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.677 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2074746
2023-04-17 19:43:15.718 +03:00 [INF] Load finished in 1057 ms
2023-04-17 19:43:15.754 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:15.756 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:15.756 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:15.766 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5101922
2023-04-17 19:43:15.766 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.767 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.768 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.769 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.770 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5101922
2023-04-17 19:43:15.915 +03:00 [INF] Load finished in 1256 ms
2023-04-17 19:43:15.925 +03:00 [INF] Load finished in 1228 ms
2023-04-17 19:43:15.926 +03:00 [INF] ProcessTargetPage was called 14 times
2023-04-17 19:43:15.927 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.928 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.929 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.931 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.950 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:15.951 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:15.952 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:15.960 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4504603
2023-04-17 19:43:15.961 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.962 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.966 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.967 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.968 +03:00 [INF] Load finished in 1277 ms
2023-04-17 19:43:15.969 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4504603
2023-04-17 19:43:15.970 +03:00 [INF] ProcessTargetPage was called 15 times
2023-04-17 19:43:15.972 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:15.973 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:15.974 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:15.976 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:15.982 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:16.287 +03:00 [INF] Load finished in 722 ms
2023-04-17 19:43:16.287 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:43:16.289 +03:00 [INF] ProcessTargetPage was called 16 times
2023-04-17 19:43:16.300 +03:00 [INF] ProcessTargetPage was called 17 times
2023-04-17 19:43:16.302 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.326 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.326 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.327 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.328 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.339 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.340 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.341 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.407 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.408 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.410 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.411 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.414 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.414 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.415 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:16.415 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.416 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.417 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.418 +03:00 [INF] ProcessTargetPage was called 18 times
2023-04-17 19:43:16.419 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.420 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.421 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.422 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.423 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.424 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4764059
2023-04-17 19:43:16.426 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.426 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.426 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.426 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4916564
2023-04-17 19:43:16.427 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.428 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.428 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.429 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.430 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.432 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.433 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.433 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.434 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.435 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.436 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.437 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.438 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.439 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.440 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.441 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.442 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.468 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.469 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.470 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.470 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.470 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.471 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.472 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.473 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.474 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.499 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.476 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.478 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.481 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4673963
2023-04-17 19:43:16.482 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.483 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.484 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.485 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.498 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.475 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.502 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4336065
2023-04-17 19:43:16.502 +03:00 [INF] Load finished in 730 ms
2023-04-17 19:43:16.503 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.504 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.505 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.505 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.506 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.507 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.510 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=743418
2023-04-17 19:43:16.513 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4764059
2023-04-17 19:43:16.514 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.515 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.516 +03:00 [INF] ProcessTargetPage was called 19 times
2023-04-17 19:43:16.517 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4316656
2023-04-17 19:43:16.518 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4916564
2023-04-17 19:43:16.519 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.520 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.521 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.522 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2567542
2023-04-17 19:43:16.523 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.527 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3371283
2023-04-17 19:43:16.528 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.529 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.530 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.533 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.533 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.534 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.535 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.536 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.537 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.538 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.539 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.540 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.545 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.547 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5019047
2023-04-17 19:43:16.548 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4996763
2023-04-17 19:43:16.549 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.550 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.551 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.552 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.553 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.554 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.555 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4673963
2023-04-17 19:43:16.557 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.558 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.560 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.561 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.562 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.563 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4336065
2023-04-17 19:43:16.565 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.566 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.568 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.568 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.570 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.571 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=743418
2023-04-17 19:43:16.573 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.576 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4316656
2023-04-17 19:43:16.577 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.578 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.579 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2567542
2023-04-17 19:43:16.581 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3371283
2023-04-17 19:43:16.582 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.583 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.586 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5019047
2023-04-17 19:43:16.589 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4996763
2023-04-17 19:43:16.605 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.606 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.608 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.608 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.609 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.610 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.611 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5071171
2023-04-17 19:43:16.611 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.612 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.614 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.613 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.615 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.616 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.617 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.618 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.619 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.620 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.621 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5071171
2023-04-17 19:43:16.623 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5758103
2023-04-17 19:43:16.624 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.626 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.627 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.628 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.629 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.630 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.633 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1807498
2023-04-17 19:43:16.637 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.638 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.639 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5758103
2023-04-17 19:43:16.640 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.642 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.643 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.644 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1807498
2023-04-17 19:43:16.873 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.873 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.875 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.875 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.876 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.878 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4642853
2023-04-17 19:43:16.878 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.879 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.881 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.882 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.883 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4642853
2023-04-17 19:43:16.929 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:16.931 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:16.932 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:16.933 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:16.935 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:16.937 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4535882
2023-04-17 19:43:16.939 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:16.940 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:16.943 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:16.945 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:16.946 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4535882
2023-04-17 19:43:17.068 +03:00 [INF] Load finished in 1096 ms
2023-04-17 19:43:17.069 +03:00 [INF] ProcessTargetPage was called 20 times
2023-04-17 19:43:17.070 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.071 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.073 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.074 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.241 +03:00 [INF] Load finished in 717 ms
2023-04-17 19:43:17.243 +03:00 [INF] ProcessTargetPage was called 21 times
2023-04-17 19:43:17.245 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.246 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.247 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.248 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.267 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:43:17.268 +03:00 [INF] ProcessTargetPage was called 22 times
2023-04-17 19:43:17.278 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.279 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.281 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.283 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.287 +03:00 [INF] Load finished in 720 ms
2023-04-17 19:43:17.288 +03:00 [INF] ProcessTargetPage was called 23 times
2023-04-17 19:43:17.289 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.291 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.292 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.293 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.306 +03:00 [INF] Load finished in 732 ms
2023-04-17 19:43:17.309 +03:00 [INF] ProcessTargetPage was called 24 times
2023-04-17 19:43:17.311 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.312 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.314 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:43:17.314 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.317 +03:00 [INF] ProcessTargetPage was called 25 times
2023-04-17 19:43:17.319 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.320 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.320 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:43:17.321 +03:00 [INF] Load finished in 729 ms
2023-04-17 19:43:17.322 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.325 +03:00 [INF] ProcessTargetPage was called 26 times
2023-04-17 19:43:17.327 +03:00 [INF] ProcessTargetPage was called 27 times
2023-04-17 19:43:17.327 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:17.329 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.330 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:17.330 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.331 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.332 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:17.333 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.334 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:17.335 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.336 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.337 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:17.341 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:17.360 +03:00 [INF] Load finished in 734 ms
2023-04-17 19:43:17.361 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.362 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.363 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:17.364 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:17.365 +03:00 [INF] ProcessTargetPage was called 28 times
2023-04-17 19:43:17.376 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.376 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:43:17.377 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.378 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:17.378 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:17.380 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.382 +03:00 [INF] ProcessTargetPage was called 29 times
2023-04-17 19:43:17.387 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=870349
2023-04-17 19:43:17.389 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4710462
2023-04-17 19:43:17.390 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.391 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.392 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.393 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.394 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.395 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.396 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.397 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.400 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.401 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.402 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.403 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.412 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.413 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.417 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.420 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=870349
2023-04-17 19:43:17.421 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4710462
2023-04-17 19:43:17.425 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:17.426 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:17.427 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:17.428 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:17.431 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:17.433 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2243087
2023-04-17 19:43:17.434 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.435 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.436 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.437 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.439 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2243087
2023-04-17 19:43:17.485 +03:00 [INF] Load finished in 904 ms
2023-04-17 19:43:17.487 +03:00 [INF] ProcessTargetPage was called 30 times
2023-04-17 19:43:17.488 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.489 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.490 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.491 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.536 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:17.537 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:17.538 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:17.540 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:17.543 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:17.545 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1789555
2023-04-17 19:43:17.545 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.547 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.548 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.549 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.550 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1789555
2023-04-17 19:43:17.557 +03:00 [INF] Load finished in 912 ms
2023-04-17 19:43:17.558 +03:00 [INF] ProcessTargetPage was called 31 times
2023-04-17 19:43:17.559 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.560 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.561 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.562 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.566 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:17.606 +03:00 [INF] Load finished in 722 ms
2023-04-17 19:43:17.608 +03:00 [INF] ProcessTargetPage was called 32 times
2023-04-17 19:43:17.609 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.611 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.612 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.613 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.663 +03:00 [INF] Load finished in 1083 ms
2023-04-17 19:43:17.666 +03:00 [INF] ProcessTargetPage was called 33 times
2023-04-17 19:43:17.667 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.667 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.669 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.670 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.681 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:17.686 +03:00 [INF] Load finished in 737 ms
2023-04-17 19:43:17.687 +03:00 [INF] ProcessTargetPage was called 34 times
2023-04-17 19:43:17.689 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.690 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.691 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.692 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:17.811 +03:00 [INF] Load finished in 1225 ms
2023-04-17 19:43:17.813 +03:00 [INF] ProcessTargetPage was called 35 times
2023-04-17 19:43:17.815 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:17.816 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:17.818 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:17.819 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.011 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.012 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.013 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.014 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.015 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.017 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2250483
2023-04-17 19:43:18.018 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.019 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.020 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.021 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.023 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2250483
2023-04-17 19:43:18.141 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:43:18.143 +03:00 [INF] ProcessTargetPage was called 36 times
2023-04-17 19:43:18.144 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.144 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.146 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.147 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.151 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:18.159 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:18.160 +03:00 [INF] ProcessTargetPage was called 37 times
2023-04-17 19:43:18.161 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.162 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.173 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.174 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.241 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.242 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.243 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.243 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.244 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.246 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1723805
2023-04-17 19:43:18.247 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.247 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.249 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.250 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.251 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1723805
2023-04-17 19:43:18.287 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:18.288 +03:00 [INF] ProcessTargetPage was called 38 times
2023-04-17 19:43:18.291 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.292 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.292 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.292 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.294 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.295 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.296 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.296 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.298 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.299 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1633312
2023-04-17 19:43:18.300 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.315 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.317 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.318 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.319 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1633312
2023-04-17 19:43:18.324 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.325 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.326 +03:00 [INF] Load finished in 885 ms
2023-04-17 19:43:18.326 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.327 +03:00 [INF] ProcessTargetPage was called 39 times
2023-04-17 19:43:18.329 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.330 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.331 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.332 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.334 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1744485
2023-04-17 19:43:18.336 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.337 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.339 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.340 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.342 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.343 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.344 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1744485
2023-04-17 19:43:18.353 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.354 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.355 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.355 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.356 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.357 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.357 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.358 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.359 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.360 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.361 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.362 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.363 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.364 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2060400
2023-04-17 19:43:18.365 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.368 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.369 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.370 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4025150
2023-04-17 19:43:18.372 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1811420
2023-04-17 19:43:18.373 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.374 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.375 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.376 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.377 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.378 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.379 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.380 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.386 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.387 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2060400
2023-04-17 19:43:18.387 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.408 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.409 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.411 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4025150
2023-04-17 19:43:18.414 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.415 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1811420
2023-04-17 19:43:18.421 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.422 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.423 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.425 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1680791
2023-04-17 19:43:18.426 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.426 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.429 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.430 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.431 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1680791
2023-04-17 19:43:18.447 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.447 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.449 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.449 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.450 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.453 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5242423
2023-04-17 19:43:18.454 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.454 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.456 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.456 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.458 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5242423
2023-04-17 19:43:18.492 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.493 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.494 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.495 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.496 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.498 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4523367
2023-04-17 19:43:18.501 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.502 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.503 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.504 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.505 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4523367
2023-04-17 19:43:18.533 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.534 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.536 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.537 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.540 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.543 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6299167
2023-04-17 19:43:18.544 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.544 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.546 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.547 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.548 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6299167
2023-04-17 19:43:18.549 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.550 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.551 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.551 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.553 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.556 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4051771
2023-04-17 19:43:18.557 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.558 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.559 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.561 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.562 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4051771
2023-04-17 19:43:18.746 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:43:18.747 +03:00 [INF] ProcessTargetPage was called 40 times
2023-04-17 19:43:18.748 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.749 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.750 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.751 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.775 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.776 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.777 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.778 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.779 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.781 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6307446
2023-04-17 19:43:18.782 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.783 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.784 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.785 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.786 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.786 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6307446
2023-04-17 19:43:18.787 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.792 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.793 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.794 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.795 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.796 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2342&start=50
2023-04-17 19:43:18.796 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.797 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.798 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.799 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.800 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.802 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.803 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.806 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.807 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:18.807 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6337849
2023-04-17 19:43:18.808 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2342&start=50
2023-04-17 19:43:18.809 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:18.810 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.812 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:18.813 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.814 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:18.815 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.816 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:18.817 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.823 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5784362
2023-04-17 19:43:18.825 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6337849
2023-04-17 19:43:18.825 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.827 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.828 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.830 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:18.831 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5784362
2023-04-17 19:43:18.988 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:18.989 +03:00 [INF] ProcessTargetPage was called 41 times
2023-04-17 19:43:18.991 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:18.992 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:18.994 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:18.995 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.065 +03:00 [INF] Load finished in 742 ms
2023-04-17 19:43:19.068 +03:00 [INF] Load finished in 722 ms
2023-04-17 19:43:19.069 +03:00 [INF] ProcessTargetPage was called 42 times
2023-04-17 19:43:19.074 +03:00 [INF] ProcessTargetPage was called 43 times
2023-04-17 19:43:19.075 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.078 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.079 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.081 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.083 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.086 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.088 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.088 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:19.090 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.092 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:19.120 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:19.121 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:19.122 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:19.125 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6352160
2023-04-17 19:43:19.126 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.131 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:43:19.132 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.134 +03:00 [INF] ProcessTargetPage was called 44 times
2023-04-17 19:43:19.135 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.136 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.139 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.141 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.143 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6352160
2023-04-17 19:43:19.143 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.146 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.157 +03:00 [INF] Load finished in 724 ms
2023-04-17 19:43:19.158 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:19.159 +03:00 [INF] ProcessTargetPage was called 45 times
2023-04-17 19:43:19.159 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:19.160 +03:00 [INF] Load finished in 738 ms
2023-04-17 19:43:19.161 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.165 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:19.166 +03:00 [INF] ProcessTargetPage was called 46 times
2023-04-17 19:43:19.167 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.168 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:19.169 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.172 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.173 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:19.175 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.178 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.179 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6352156
2023-04-17 19:43:19.180 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.182 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.184 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.185 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.186 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.188 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.190 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.191 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.203 +03:00 [INF] Load finished in 743 ms
2023-04-17 19:43:19.207 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6352156
2023-04-17 19:43:19.208 +03:00 [INF] ProcessTargetPage was called 47 times
2023-04-17 19:43:19.210 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.211 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.213 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.214 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.243 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:43:19.244 +03:00 [INF] ProcessTargetPage was called 48 times
2023-04-17 19:43:19.245 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.246 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.247 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.248 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.286 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:19.288 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:19.289 +03:00 [INF] Load finished in 739 ms
2023-04-17 19:43:19.290 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:19.291 +03:00 [INF] ProcessTargetPage was called 49 times
2023-04-17 19:43:19.292 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:19.293 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.294 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:19.294 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:19.295 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.297 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6336645
2023-04-17 19:43:19.297 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:19.297 +03:00 [INF] Load finished in 734 ms
2023-04-17 19:43:19.298 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.299 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.300 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:19.303 +03:00 [INF] ProcessTargetPage was called 50 times
2023-04-17 19:43:19.304 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.305 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.306 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:19.307 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.309 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.310 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:19.311 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.312 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.313 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6341924
2023-04-17 19:43:19.314 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.316 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6336645
2023-04-17 19:43:19.316 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector div.attach_link.guest>ul>li:nth-child(2).
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.321 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.323 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.326 +03:00 [INF] Load finished in 910 ms
2023-04-17 19:43:19.327 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.327 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .magnet-link.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.329 +03:00 [INF] ProcessTargetPage was called 51 times
2023-04-17 19:43:19.330 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.352 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.352 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.353 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.356 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.357 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6341924
2023-04-17 19:43:19.358 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.360 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.695 +03:00 [INF] Load finished in 905 ms
2023-04-17 19:43:19.696 +03:00 [INF] ProcessTargetPage was called 52 times
2023-04-17 19:43:19.698 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.699 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.700 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.701 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.716 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector div.attach_link.guest>ul>li:nth-child(2).
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.719 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .magnet-link.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.721 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.725 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:19.726 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:19.727 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:19.728 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:19.729 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:19.731 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5929358
2023-04-17 19:43:19.732 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.733 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.734 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.736 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.739 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5929358
2023-04-17 19:43:19.858 +03:00 [INF] Load finished in 714 ms
2023-04-17 19:43:19.859 +03:00 [INF] ProcessTargetPage was called 53 times
2023-04-17 19:43:19.861 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.862 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.863 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.864 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.905 +03:00 [INF] Load finished in 1093 ms
2023-04-17 19:43:19.923 +03:00 [INF] Load finished in 1091 ms
2023-04-17 19:43:19.924 +03:00 [INF] ProcessTargetPage was called 54 times
2023-04-17 19:43:19.927 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:19.928 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:19.930 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:19.931 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:19.975 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:19.975 +03:00 [INF] Found 1 with pagination
2023-04-17 19:43:19.982 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:19.983 +03:00 [INF] Received 30 new jobs
2023-04-17 19:43:19.985 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:19.987 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:19.985 +03:00 [INF] Start RedisScheduler.AddAsync with 30 jobs
2023-04-17 19:43:19.988 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector div.attach_link.guest>ul>li:nth-child(2).
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.988 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:19.993 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .magnet-link.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:19.994 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6213428
2023-04-17 19:43:19.995 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6217062
2023-04-17 19:43:20.008 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.009 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.010 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.011 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.012 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.013 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.014 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.042 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.043 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6213428
2023-04-17 19:43:20.044 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6217062
2023-04-17 19:43:20.053 +03:00 [INF] Load finished in 729 ms
2023-04-17 19:43:20.054 +03:00 [INF] ProcessTargetPage was called 55 times
2023-04-17 19:43:20.056 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.057 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.059 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.060 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.083 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.085 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.086 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.087 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.089 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.089 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.091 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6304649
2023-04-17 19:43:20.091 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.092 +03:00 [INF] Load finished in 732 ms
2023-04-17 19:43:20.092 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.092 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.094 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.095 +03:00 [INF] ProcessTargetPage was called 56 times
2023-04-17 19:43:20.096 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.099 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.100 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.101 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.106 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.104 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.105 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.103 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.108 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.109 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.110 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351967
2023-04-17 19:43:20.111 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.114 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.115 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6304649
2023-04-17 19:43:20.116 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.118 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.130 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.132 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351964
2023-04-17 19:43:20.133 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.134 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.135 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.136 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.138 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351967
2023-04-17 19:43:20.160 +03:00 [INF] Load finished in 1334 ms
2023-04-17 19:43:20.160 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.163 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.163 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.165 +03:00 [INF] ProcessTargetPage was called 57 times
2023-04-17 19:43:20.166 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.167 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.168 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.176 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.177 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.178 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351964
2023-04-17 19:43:20.179 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.179 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.180 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.181 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.183 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.184 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.186 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.187 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.188 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.191 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.193 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.193 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.195 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.196 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.198 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6349836
2023-04-17 19:43:20.200 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6348526
2023-04-17 19:43:20.200 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.201 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.203 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.206 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.208 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6343486
2023-04-17 19:43:20.209 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.210 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.211 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.212 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.213 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.214 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.215 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.216 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.217 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6349424
2023-04-17 19:43:20.225 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.226 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.227 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.227 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.229 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6349836
2023-04-17 19:43:20.230 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6348526
2023-04-17 19:43:20.232 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.232 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.236 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6343486
2023-04-17 19:43:20.237 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.239 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.241 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6349424
2023-04-17 19:43:20.294 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.294 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.295 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.296 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.298 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.299 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.299 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.300 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.301 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.303 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.305 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6291762
2023-04-17 19:43:20.305 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.306 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351555
2023-04-17 19:43:20.307 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.308 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.309 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.311 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.312 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.313 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.314 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.317 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.320 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.322 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.323 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.324 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.325 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6291762
2023-04-17 19:43:20.326 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351749
2023-04-17 19:43:20.327 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351555
2023-04-17 19:43:20.329 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.333 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.335 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.336 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.338 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351749
2023-04-17 19:43:20.477 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:20.478 +03:00 [INF] ProcessTargetPage was called 58 times
2023-04-17 19:43:20.480 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.481 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.482 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.483 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.652 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.653 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.654 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.655 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.656 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.660 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351560
2023-04-17 19:43:20.661 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.662 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.663 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.664 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.673 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351560
2023-04-17 19:43:20.761 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:43:20.762 +03:00 [INF] ProcessTargetPage was called 59 times
2023-04-17 19:43:20.763 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.764 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.766 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.767 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.774 +03:00 [INF] Load finished in 728 ms
2023-04-17 19:43:20.775 +03:00 [INF] ProcessTargetPage was called 60 times
2023-04-17 19:43:20.776 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.777 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.779 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.780 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.858 +03:00 [INF] Load finished in 1648 ms
2023-04-17 19:43:20.858 +03:00 [INF] Load finished in 738 ms
2023-04-17 19:43:20.860 +03:00 [INF] ProcessTargetPage was called 62 times
2023-04-17 19:43:20.859 +03:00 [INF] ProcessTargetPage was called 61 times
2023-04-17 19:43:20.860 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.861 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.862 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.865 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.864 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.863 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.866 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.867 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.868 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.869 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.870 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.870 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.873 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.875 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351545
2023-04-17 19:43:20.876 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.876 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.879 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.882 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.884 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351545
2023-04-17 19:43:20.895 +03:00 [INF] Load finished in 731 ms
2023-04-17 19:43:20.897 +03:00 [INF] ProcessTargetPage was called 63 times
2023-04-17 19:43:20.898 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.899 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.900 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.901 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.962 +03:00 [INF] Load finished in 727 ms
2023-04-17 19:43:20.963 +03:00 [INF] ProcessTargetPage was called 64 times
2023-04-17 19:43:20.964 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.965 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.967 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.968 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.969 +03:00 [INF] Load finished in 731 ms
2023-04-17 19:43:20.972 +03:00 [INF] ProcessTargetPage was called 65 times
2023-04-17 19:43:20.975 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.976 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:20.977 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:20.977 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:20.978 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:20.979 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:20.981 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:20.981 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:20.983 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:20.994 +03:00 [INF] Load finished in 752 ms
2023-04-17 19:43:20.995 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351543
2023-04-17 19:43:20.997 +03:00 [INF] ProcessTargetPage was called 66 times
2023-04-17 19:43:20.998 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:20.999 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.000 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.001 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.005 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.006 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.008 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.009 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.010 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.011 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.012 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.013 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351543
2023-04-17 19:43:21.014 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.016 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.020 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6342525
2023-04-17 19:43:21.021 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.022 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.023 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.024 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.025 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6342525
2023-04-17 19:43:21.041 +03:00 [INF] Load finished in 713 ms
2023-04-17 19:43:21.042 +03:00 [INF] ProcessTargetPage was called 67 times
2023-04-17 19:43:21.043 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.044 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.046 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.047 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.049 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:43:21.052 +03:00 [INF] ProcessTargetPage was called 68 times
2023-04-17 19:43:21.060 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.071 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.083 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.088 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.093 +03:00 [INF] Load finished in 910 ms
2023-04-17 19:43:21.096 +03:00 [INF] ProcessTargetPage was called 69 times
2023-04-17 19:43:21.096 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.099 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.101 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.102 +03:00 [INF] Load finished in 762 ms
2023-04-17 19:43:21.106 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.113 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.114 +03:00 [INF] ProcessTargetPage was called 70 times
2023-04-17 19:43:21.116 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.116 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.117 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.119 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.120 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.121 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.126 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5420098
2023-04-17 19:43:21.127 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.128 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.129 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.130 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.132 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.156 +03:00 [INF] Load finished in 922 ms
2023-04-17 19:43:21.157 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.158 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.158 +03:00 [INF] ProcessTargetPage was called 71 times
2023-04-17 19:43:21.167 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.160 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.159 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5420098
2023-04-17 19:43:21.169 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.176 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.178 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.178 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.180 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.181 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.183 +03:00 [INF] Application is shutting down...
2023-04-17 19:43:21.184 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6302793
2023-04-17 19:43:21.188 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.189 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.190 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.192 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.193 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6302793
2023-04-17 19:43:21.407 +03:00 [INF] Load finished in 730 ms
2023-04-17 19:43:21.408 +03:00 [INF] ProcessTargetPage was called 72 times
2023-04-17 19:43:21.409 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.411 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.412 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.414 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.450 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.451 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.453 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.454 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.455 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.614 +03:00 [INF] Load finished in 729 ms
2023-04-17 19:43:21.615 +03:00 [INF] ProcessTargetPage was called 73 times
2023-04-17 19:43:21.617 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.617 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.619 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.620 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.699 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.700 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.701 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.702 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.704 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.738 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.739 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.741 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.741 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.742 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.743 +03:00 [INF] Load finished in 728 ms
2023-04-17 19:43:21.745 +03:00 [INF] ProcessTargetPage was called 74 times
2023-04-17 19:43:21.746 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.749 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.752 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.773 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.773 +03:00 [INF] Load finished in 747 ms
2023-04-17 19:43:21.776 +03:00 [INF] ProcessTargetPage was called 75 times
2023-04-17 19:43:21.777 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.778 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.782 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.792 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.807 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.807 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.808 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.809 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.811 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.813 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.814 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.815 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.816 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.817 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.916 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.917 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.918 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.921 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.922 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.927 +03:00 [INF] Load finished in 732 ms
2023-04-17 19:43:21.928 +03:00 [INF] ProcessTargetPage was called 76 times
2023-04-17 19:43:21.929 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:21.929 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:21.931 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:21.932 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:21.938 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.939 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.940 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.941 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.942 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.977 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.978 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.979 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.980 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.981 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:21.981 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:21.986 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:21.987 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:21.988 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:21.989 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.056 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.057 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.058 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.059 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.059 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.060 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.061 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.062 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.064 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.065 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.079 +03:00 [INF] Load finished in 902 ms
2023-04-17 19:43:22.081 +03:00 [INF] ProcessTargetPage was called 77 times
2023-04-17 19:43:22.082 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:22.083 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:22.084 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:22.086 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:22.133 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.134 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.135 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.136 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.137 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.372 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.373 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.375 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.375 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.377 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.709 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.710 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.711 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.712 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.713 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.727 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.727 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.755 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.756 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.757 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.757 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.758 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.759 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.760 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.762 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.893 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.894 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.895 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:22.896 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.897 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:22.898 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.899 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:22.900 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:22.900 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:22.903 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:23.041 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:23.042 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:23.043 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:23.044 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:23.045 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:23.694 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:23.695 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:23.696 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:23.697 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:23.698 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:36.166 +03:00 [INF] Start ScraperEngine.RunAsync
2023-04-17 19:43:36.166 +03:00 [INF] Application started. Press Ctrl+C to shut down.
2023-04-17 19:43:36.211 +03:00 [INF] Hosting environment: Development
2023-04-17 19:43:36.212 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:36.212 +03:00 [INF] Content root path: C:\Projects\WebReaper\Examples\WebReaper.ScraperWorkerService
2023-04-17 19:43:36.213 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:36.216 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:36.222 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:36.268 +03:00 [INF] Scheduling the initial scraping job with start url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:43:36.270 +03:00 [INF] Start RedisScheduler.AddAsync
2023-04-17 19:43:36.280 +03:00 [INF] Start consuming the scraping jobs
2023-04-17 19:43:36.284 +03:00 [INF] Start RedisScheduler.GetAllAsync
2023-04-17 19:43:36.291 +03:00 [INF] Start crawling url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:43:36.310 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:36.311 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:36.312 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:36.314 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:36.322 +03:00 [INF] Loading static page https://rutracker.org/forum/index.php?c=33
2023-04-17 19:43:37.205 +03:00 [INF] Load finished in 879 ms
2023-04-17 19:43:37.492 +03:00 [INF] Received 6 new jobs
2023-04-17 19:43:37.495 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:43:37.533 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:43:37.534 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:43:37.534 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:43:37.535 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:37.535 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:43:37.536 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:37.536 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:43:37.536 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:43:37.537 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:37.537 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:37.538 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:37.539 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:37.540 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:37.541 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:37.542 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:37.543 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:37.544 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:37.545 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:37.546 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:37.547 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:37.549 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:37.553 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:37.554 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:37.555 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:37.556 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:37.557 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:37.558 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:37.560 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:43:37.560 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:37.561 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:43:37.562 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:37.563 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:37.567 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:43:37.569 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:43:37.571 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:43:37.571 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:43:38.339 +03:00 [INF] Load finished in 766 ms
2023-04-17 19:43:38.348 +03:00 [INF] Load finished in 778 ms
2023-04-17 19:43:38.348 +03:00 [INF] Received 8 new jobs
2023-04-17 19:43:38.357 +03:00 [INF] Load finished in 785 ms
2023-04-17 19:43:38.357 +03:00 [INF] Load finished in 782 ms
2023-04-17 19:43:38.358 +03:00 [INF] Load finished in 783 ms
2023-04-17 19:43:38.358 +03:00 [INF] Start RedisScheduler.AddAsync with 8 jobs
2023-04-17 19:43:38.359 +03:00 [INF] Received 3 new jobs
2023-04-17 19:43:38.364 +03:00 [INF] Start RedisScheduler.AddAsync with 3 jobs
2023-04-17 19:43:38.366 +03:00 [INF] Received 4 new jobs
2023-04-17 19:43:38.367 +03:00 [INF] Received 6 new jobs
2023-04-17 19:43:38.367 +03:00 [INF] Received 4 new jobs
2023-04-17 19:43:38.368 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:43:38.369 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:43:38.370 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:43:38.476 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:43:38.477 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:43:38.476 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:43:38.477 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:43:38.477 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:43:38.476 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:43:38.477 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.477 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:43:38.478 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:43:38.478 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:43:38.478 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.479 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:43:38.479 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:43:38.479 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.479 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:43:38.480 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:43:38.480 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:43:38.480 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.480 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:43:38.481 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:43:38.481 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.482 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.483 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.484 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.485 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.486 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.487 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.488 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.488 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.489 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.490 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.491 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.495 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.496 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.497 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.498 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.499 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.500 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.501 +03:00 [INF] Load finished in 934 ms
2023-04-17 19:43:38.502 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.503 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.504 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.505 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.506 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.507 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.509 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.510 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.511 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.512 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.513 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:43:38.514 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.515 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.516 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.517 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.519 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.520 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.521 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:43:38.522 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.523 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.528 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.529 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.530 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.531 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.532 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:43:38.533 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.534 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.535 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.535 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.536 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.538 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.539 +03:00 [INF] Received 5 new jobs
2023-04-17 19:43:38.540 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.542 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.543 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.544 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.545 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.545 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.546 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.547 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.548 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.549 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.551 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.551 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.552 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.554 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:43:38.555 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.559 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.560 +03:00 [INF] Start RedisScheduler.AddAsync with 5 jobs
2023-04-17 19:43:38.561 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:43:38.562 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.563 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.564 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.565 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.566 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:43:38.566 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:43:38.567 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:43:38.568 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:43:38.569 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.570 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.576 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:43:38.577 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:43:38.578 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:43:38.579 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:43:38.580 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:43:38.581 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:43:38.582 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:43:38.583 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.584 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:43:38.585 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:43:38.587 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:43:38.588 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:43:38.592 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.593 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.602 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.607 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:38.610 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.612 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:43:38.612 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:43:38.613 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:38.614 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:43:38.619 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:38.621 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:38.622 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:43:39.470 +03:00 [INF] Load finished in 879 ms
2023-04-17 19:43:39.503 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.503 +03:00 [INF] Load finished in 914 ms
2023-04-17 19:43:39.508 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.509 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.528 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:43:39.529 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.530 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.531 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.533 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.534 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:43:39.541 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.543 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.544 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.554 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:43:39.555 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.556 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.557 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.558 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.559 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:43:39.561 +03:00 [INF] Load finished in 966 ms
2023-04-17 19:43:39.571 +03:00 [INF] Load finished in 964 ms
2023-04-17 19:43:39.597 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.599 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.600 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.613 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:43:39.614 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.616 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.617 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.618 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.619 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:43:39.630 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.632 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.633 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.641 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:43:39.643 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.644 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.645 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.647 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.648 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:43:39.663 +03:00 [INF] Load finished in 1085 ms
2023-04-17 19:43:39.671 +03:00 [INF] Load finished in 1089 ms
2023-04-17 19:43:39.688 +03:00 [INF] Load finished in 1094 ms
2023-04-17 19:43:39.701 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.703 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.703 +03:00 [INF] Load finished in 1105 ms
2023-04-17 19:43:39.705 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.718 +03:00 [INF] Load finished in 1121 ms
2023-04-17 19:43:39.718 +03:00 [INF] Load finished in 1109 ms
2023-04-17 19:43:39.735 +03:00 [INF] Load finished in 1138 ms
2023-04-17 19:43:39.735 +03:00 [INF] Load finished in 1135 ms
2023-04-17 19:43:39.735 +03:00 [INF] Load finished in 1117 ms
2023-04-17 19:43:39.737 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.738 +03:00 [INF] Load finished in 1122 ms
2023-04-17 19:43:39.757 +03:00 [INF] Load finished in 1137 ms
2023-04-17 19:43:39.767 +03:00 [INF] Load finished in 1157 ms
2023-04-17 19:43:39.800 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.801 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:43:39.801 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.814 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.817 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.818 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.820 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.821 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:43:39.824 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=396
2023-04-17 19:43:39.824 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.825 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.827 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.856 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.857 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:39.858 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:39.882 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2322
2023-04-17 19:43:39.895 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.896 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.897 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.898 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.899 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:39.938 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.938 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:39.941 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.964 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2167
2023-04-17 19:43:39.965 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.966 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.966 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.968 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.968 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:39.970 +03:00 [INF] Found 9 with pagination
2023-04-17 19:43:39.971 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.972 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:39.974 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:39.976 +03:00 [INF] Received 59 new jobs
2023-04-17 19:43:39.976 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.976 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1993
2023-04-17 19:43:39.977 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:39.978 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:39.979 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:43:39.981 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:39.982 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:39.997 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:39.998 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:40.013 +03:00 [INF] Load finished in 1425 ms
2023-04-17 19:43:40.014 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.014 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2321
2023-04-17 19:43:40.017 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6149034
2023-04-17 19:43:40.018 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6342283
2023-04-17 19:43:40.034 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.035 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6318441
2023-04-17 19:43:40.035 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.036 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.037 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.037 +03:00 [INF] Found 9 with pagination
2023-04-17 19:43:40.038 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:40.039 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.039 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.040 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.042 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.042 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.045 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:40.045 +03:00 [INF] Received 59 new jobs
2023-04-17 19:43:40.047 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.088 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.088 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.089 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.090 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.091 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.092 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.092 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.093 +03:00 [INF] Load finished in 1469 ms
2023-04-17 19:43:40.094 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6186462
2023-04-17 19:43:40.095 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:43:40.096 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.096 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.107 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.107 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.108 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.113 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.113 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.114 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.116 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.118 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.121 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.138 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.142 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.143 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:40.144 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6259840
2023-04-17 19:43:40.144 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.145 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6149034
2023-04-17 19:43:40.146 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6352178
2023-04-17 19:43:40.146 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6342283
2023-04-17 19:43:40.147 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.172 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.173 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.176 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6318441
2023-04-17 19:43:40.176 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.177 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:40.178 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.178 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.182 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.183 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5918419
2023-04-17 19:43:40.189 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6013673
2023-04-17 19:43:40.190 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.195 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.196 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5452197
2023-04-17 19:43:40.197 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5731381
2023-04-17 19:43:40.198 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.198 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.199 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.200 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.201 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351738
2023-04-17 19:43:40.201 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.204 +03:00 [INF] Load finished in 1613 ms
2023-04-17 19:43:40.206 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.207 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.208 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.210 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.211 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.212 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.213 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.214 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.215 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.216 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.230 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6186462
2023-04-17 19:43:40.232 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.234 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.244 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.245 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351733
2023-04-17 19:43:40.245 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.247 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.248 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.252 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.253 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351346
2023-04-17 19:43:40.264 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.267 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.268 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.269 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6259840
2023-04-17 19:43:40.270 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.271 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6352178
2023-04-17 19:43:40.272 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.273 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.274 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.275 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.276 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.277 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.279 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.281 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.284 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5918419
2023-04-17 19:43:40.286 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.287 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6013673
2023-04-17 19:43:40.288 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.289 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5452197
2023-04-17 19:43:40.290 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5731381
2023-04-17 19:43:40.291 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.292 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.294 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351738
2023-04-17 19:43:40.301 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.307 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.310 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.312 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351733
2023-04-17 19:43:40.314 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351346
2023-04-17 19:43:40.315 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5908310
2023-04-17 19:43:40.317 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.318 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.319 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.321 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.322 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5908310
2023-04-17 19:43:40.431 +03:00 [INF] Load finished in 1831 ms
2023-04-17 19:43:40.474 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.476 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.477 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.486 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351242
2023-04-17 19:43:40.487 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.488 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.490 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.492 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.493 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351242
2023-04-17 19:43:40.538 +03:00 [INF] Load finished in 912 ms
2023-04-17 19:43:40.570 +03:00 [INF] Found 1 with pagination
2023-04-17 19:43:40.571 +03:00 [INF] Received 51 new jobs
2023-04-17 19:43:40.572 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:43:40.581 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6209267
2023-04-17 19:43:40.581 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.582 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.584 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.585 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.586 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6209267
2023-04-17 19:43:40.612 +03:00 [INF] Load finished in 1051 ms
2023-04-17 19:43:40.618 +03:00 [INF] Load finished in 1082 ms
2023-04-17 19:43:40.647 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.650 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.656 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.657 +03:00 [INF] Found 7 with pagination
2023-04-17 19:43:40.661 +03:00 [INF] Received 57 new jobs
2023-04-17 19:43:40.662 +03:00 [INF] Start RedisScheduler.AddAsync with 57 jobs
2023-04-17 19:43:40.666 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5532219
2023-04-17 19:43:40.667 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.668 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.672 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4452035
2023-04-17 19:43:40.673 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.674 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.675 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.676 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.677 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5532219
2023-04-17 19:43:40.678 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.681 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.683 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4452035
2023-04-17 19:43:40.731 +03:00 [INF] Load finished in 908 ms
2023-04-17 19:43:40.757 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:40.759 +03:00 [INF] Received 55 new jobs
2023-04-17 19:43:40.760 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:43:40.770 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3735716
2023-04-17 19:43:40.771 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.772 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.774 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.775 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.776 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3735716
2023-04-17 19:43:40.905 +03:00 [INF] Load finished in 712 ms
2023-04-17 19:43:40.913 +03:00 [INF] ProcessTargetPage was called 1 times
2023-04-17 19:43:40.915 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.915 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:43:40.916 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.917 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:43:40.919 +03:00 [INF] ProcessTargetPage was called 2 times
2023-04-17 19:43:40.919 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.921 +03:00 [INF] ProcessTargetPage was called 3 times
2023-04-17 19:43:40.922 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.923 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.924 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.925 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.927 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.928 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.930 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.931 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.932 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:40.982 +03:00 [INF] Load finished in 729 ms
2023-04-17 19:43:40.984 +03:00 [INF] ProcessTargetPage was called 4 times
2023-04-17 19:43:40.985 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:40.986 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:40.988 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:40.989 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.001 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:43:41.002 +03:00 [INF] ProcessTargetPage was called 5 times
2023-04-17 19:43:41.003 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.004 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.005 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.006 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.011 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:43:41.014 +03:00 [INF] ProcessTargetPage was called 6 times
2023-04-17 19:43:41.017 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.018 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.019 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.021 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.025 +03:00 [INF] Load finished in 722 ms
2023-04-17 19:43:41.026 +03:00 [INF] ProcessTargetPage was called 7 times
2023-04-17 19:43:41.029 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.029 +03:00 [INF] Load finished in 724 ms
2023-04-17 19:43:41.030 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:43:41.030 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.031 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:41.032 +03:00 [INF] ProcessTargetPage was called 8 times
2023-04-17 19:43:41.033 +03:00 [INF] ProcessTargetPage was called 9 times
2023-04-17 19:43:41.033 +03:00 [INF] Load finished in 717 ms
2023-04-17 19:43:41.034 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.035 +03:00 [INF] ProcessTargetPage was called 10 times
2023-04-17 19:43:41.037 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.038 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.039 +03:00 [INF] ProcessTargetPage was called 11 times
2023-04-17 19:43:41.040 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.042 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.043 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.043 +03:00 [INF] Load finished in 728 ms
2023-04-17 19:43:41.047 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.048 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.050 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.052 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.053 +03:00 [INF] ProcessTargetPage was called 12 times
2023-04-17 19:43:41.055 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.056 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.057 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.057 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:43:41.058 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.059 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.062 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.063 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.065 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.066 +03:00 [INF] ProcessTargetPage was called 13 times
2023-04-17 19:43:41.068 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.070 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.080 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.081 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.083 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.085 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.086 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.088 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.188 +03:00 [INF] Load finished in 908 ms
2023-04-17 19:43:41.189 +03:00 [INF] ProcessTargetPage was called 14 times
2023-04-17 19:43:41.190 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.191 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.192 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.194 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.211 +03:00 [INF] Load finished in 717 ms
2023-04-17 19:43:41.212 +03:00 [INF] ProcessTargetPage was called 15 times
2023-04-17 19:43:41.213 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.214 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.215 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.217 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.353 +03:00 [INF] Load finished in 765 ms
2023-04-17 19:43:41.354 +03:00 [INF] ProcessTargetPage was called 16 times
2023-04-17 19:43:41.356 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.359 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.360 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.361 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.415 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:41.417 +03:00 [INF] ProcessTargetPage was called 17 times
2023-04-17 19:43:41.418 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.419 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.421 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.422 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.514 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:41.515 +03:00 [INF] ProcessTargetPage was called 18 times
2023-04-17 19:43:41.516 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.517 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.518 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.519 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.524 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:43:41.564 +03:00 [INF] Load finished in 880 ms
2023-04-17 19:43:41.565 +03:00 [INF] ProcessTargetPage was called 19 times
2023-04-17 19:43:41.566 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.567 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.569 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.570 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.938 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:41.938 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:41.940 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:41.940 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:41.947 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:41.947 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:41.948 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:41.948 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:41.949 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:41.952 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:41.956 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351189
2023-04-17 19:43:41.957 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:41.958 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351173
2023-04-17 19:43:41.961 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.962 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:41.963 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.964 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.965 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:41.967 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.968 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:41.969 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.970 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:41.974 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:41.971 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:41.972 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.971 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:41.987 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:41.988 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351171
2023-04-17 19:43:41.989 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:41.990 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351189
2023-04-17 19:43:41.991 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:41.991 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:41.992 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:41.993 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:41.995 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351173
2023-04-17 19:43:41.996 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:41.997 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:41.999 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.001 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.002 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.004 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351169
2023-04-17 19:43:42.005 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.006 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.006 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.009 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351048
2023-04-17 19:43:42.010 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.013 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.010 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351171
2023-04-17 19:43:42.011 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.012 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.010 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.013 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.016 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.020 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.021 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.022 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.023 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.024 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.024 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.025 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.052 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.054 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.055 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.055 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.055 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.056 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.056 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.058 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351169
2023-04-17 19:43:42.059 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.059 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.060 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.062 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.063 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.064 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.065 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.067 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351048
2023-04-17 19:43:42.068 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.069 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.071 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6343636
2023-04-17 19:43:42.071 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.071 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.072 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.074 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6241245
2023-04-17 19:43:42.076 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5992255
2023-04-17 19:43:42.082 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.083 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.084 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.085 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.086 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.087 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.088 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.089 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.090 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.091 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.092 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.096 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4194303
2023-04-17 19:43:42.097 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.098 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.100 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6324688
2023-04-17 19:43:42.101 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.101 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.102 +03:00 [INF] Load finished in 2453 ms
2023-04-17 19:43:42.103 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6317170
2023-04-17 19:43:42.104 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.105 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.106 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.109 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.112 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.112 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.115 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.116 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.117 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.118 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.119 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.120 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6343636
2023-04-17 19:43:42.122 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6207136
2023-04-17 19:43:42.123 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.125 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.132 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6241245
2023-04-17 19:43:42.133 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5992255
2023-04-17 19:43:42.134 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.135 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.136 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.138 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.139 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.140 +03:00 [INF] Found 8 with pagination
2023-04-17 19:43:42.145 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.147 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.147 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.149 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.150 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4194303
2023-04-17 19:43:42.162 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.162 +03:00 [INF] Received 58 new jobs
2023-04-17 19:43:42.163 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6324688
2023-04-17 19:43:42.164 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.165 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6317170
2023-04-17 19:43:42.167 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.168 +03:00 [INF] Start RedisScheduler.AddAsync with 58 jobs
2023-04-17 19:43:42.172 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.176 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.180 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6207136
2023-04-17 19:43:42.181 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4289875
2023-04-17 19:43:42.183 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.184 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.185 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.187 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4671587
2023-04-17 19:43:42.188 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.188 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.190 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4289875
2023-04-17 19:43:42.191 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.192 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.193 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.194 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.195 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.196 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.197 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4671587
2023-04-17 19:43:42.197 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.199 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.201 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6157656
2023-04-17 19:43:42.203 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.206 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.208 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.209 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.210 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6157656
2023-04-17 19:43:42.300 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.301 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.303 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.303 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.304 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.306 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4182183
2023-04-17 19:43:42.307 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.308 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.309 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.311 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.312 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4182183
2023-04-17 19:43:42.371 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.372 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.373 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.374 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.375 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.377 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6255699
2023-04-17 19:43:42.377 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.378 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.380 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.381 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.382 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6255699
2023-04-17 19:43:42.496 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.496 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.498 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.498 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.499 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.501 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6333727
2023-04-17 19:43:42.502 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.504 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.505 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.506 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.507 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6333727
2023-04-17 19:43:42.545 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.546 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.547 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.548 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.549 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.551 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6302628
2023-04-17 19:43:42.552 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.553 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.554 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.557 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.559 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6302628
2023-04-17 19:43:42.664 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:42.665 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:42.666 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:42.667 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:42.668 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:42.670 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4577000
2023-04-17 19:43:42.671 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.672 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.673 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.674 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.676 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4577000
2023-04-17 19:43:42.712 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:43:42.715 +03:00 [INF] ProcessTargetPage was called 20 times
2023-04-17 19:43:42.717 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.718 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.720 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.722 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.730 +03:00 [INF] Load finished in 729 ms
2023-04-17 19:43:42.732 +03:00 [INF] ProcessTargetPage was called 21 times
2023-04-17 19:43:42.733 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.734 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.735 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.737 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.757 +03:00 [INF] Load finished in 739 ms
2023-04-17 19:43:42.759 +03:00 [INF] ProcessTargetPage was called 22 times
2023-04-17 19:43:42.760 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.762 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.765 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.766 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.789 +03:00 [INF] Load finished in 714 ms
2023-04-17 19:43:42.790 +03:00 [INF] ProcessTargetPage was called 23 times
2023-04-17 19:43:42.791 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.793 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.794 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.796 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.796 +03:00 [INF] Load finished in 730 ms
2023-04-17 19:43:42.799 +03:00 [INF] ProcessTargetPage was called 24 times
2023-04-17 19:43:42.800 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.801 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.803 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.804 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.871 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:43:42.872 +03:00 [INF] ProcessTargetPage was called 25 times
2023-04-17 19:43:42.874 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.875 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.876 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.877 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.899 +03:00 [INF] Load finished in 755 ms
2023-04-17 19:43:42.899 +03:00 [INF] Load finished in 754 ms
2023-04-17 19:43:42.899 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:43:42.900 +03:00 [INF] ProcessTargetPage was called 26 times
2023-04-17 19:43:42.902 +03:00 [INF] ProcessTargetPage was called 27 times
2023-04-17 19:43:42.907 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.905 +03:00 [INF] ProcessTargetPage was called 28 times
2023-04-17 19:43:42.905 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:42.906 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.911 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.908 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.909 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:43:42.909 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.910 +03:00 [INF] ProcessTargetPage was called 29 times
2023-04-17 19:43:42.903 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:43:42.912 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.914 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.915 +03:00 [INF] ProcessTargetPage was called 30 times
2023-04-17 19:43:42.916 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.918 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.919 +03:00 [INF] ProcessTargetPage was called 31 times
2023-04-17 19:43:42.921 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.922 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.923 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.925 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.925 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.926 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.929 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.930 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.931 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:43:42.932 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.937 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.938 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.941 +03:00 [INF] ProcessTargetPage was called 32 times
2023-04-17 19:43:42.946 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.947 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:42.948 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.950 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.951 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.954 +03:00 [INF] ProcessTargetPage was called 33 times
2023-04-17 19:43:42.955 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.957 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.958 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:42.960 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.961 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:42.962 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:42.964 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:42.966 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.111 +03:00 [INF] Load finished in 727 ms
2023-04-17 19:43:43.112 +03:00 [INF] ProcessTargetPage was called 34 times
2023-04-17 19:43:43.114 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.115 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.116 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.117 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.244 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:43:43.248 +03:00 [INF] ProcessTargetPage was called 35 times
2023-04-17 19:43:43.249 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.250 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.251 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.254 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.273 +03:00 [INF] Load finished in 713 ms
2023-04-17 19:43:43.275 +03:00 [INF] ProcessTargetPage was called 36 times
2023-04-17 19:43:43.276 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.278 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.279 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.280 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.370 +03:00 [INF] Load finished in 1057 ms
2023-04-17 19:43:43.372 +03:00 [INF] ProcessTargetPage was called 37 times
2023-04-17 19:43:43.373 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.374 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.376 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.377 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.417 +03:00 [INF] Load finished in 740 ms
2023-04-17 19:43:43.418 +03:00 [INF] ProcessTargetPage was called 38 times
2023-04-17 19:43:43.419 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.420 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.422 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.423 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.686 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.687 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.689 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.689 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.690 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.692 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6206460
2023-04-17 19:43:43.693 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.694 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.696 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.699 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.701 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6206460
2023-04-17 19:43:43.704 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.704 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.706 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.706 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.708 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.710 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6111763
2023-04-17 19:43:43.711 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.713 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.715 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.726 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.727 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6111763
2023-04-17 19:43:43.757 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.758 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.759 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.770 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.771 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.773 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5547776
2023-04-17 19:43:43.799 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.800 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.801 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.803 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.804 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.806 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.808 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.822 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.822 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.822 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.824 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.824 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5547776
2023-04-17 19:43:43.825 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.826 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.828 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.829 +03:00 [INF] Load finished in 1654 ms
2023-04-17 19:43:43.830 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6222177
2023-04-17 19:43:43.831 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6061136
2023-04-17 19:43:43.832 +03:00 [INF] ProcessTargetPage was called 39 times
2023-04-17 19:43:43.833 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.834 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.834 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.839 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.839 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.840 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.842 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.843 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.843 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.844 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.845 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.846 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.847 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6222177
2023-04-17 19:43:43.848 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6061136
2023-04-17 19:43:43.882 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.883 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.884 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.885 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.886 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.888 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.888 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6075844
2023-04-17 19:43:43.889 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.890 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.892 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.892 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.893 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.895 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.895 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.896 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.897 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.899 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.901 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6081068
2023-04-17 19:43:43.903 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.905 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6075844
2023-04-17 19:43:43.905 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.906 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.907 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.909 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.910 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.911 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.912 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.913 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.913 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.916 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.917 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.917 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.918 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.920 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6127519
2023-04-17 19:43:43.923 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6164298
2023-04-17 19:43:43.924 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.925 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6081068
2023-04-17 19:43:43.925 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.926 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.927 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.929 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.930 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.932 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.935 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.936 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.937 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.938 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6196279
2023-04-17 19:43:43.939 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.940 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.941 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.942 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.943 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6127519
2023-04-17 19:43:43.944 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6164298
2023-04-17 19:43:43.944 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.948 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.948 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:43.952 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.954 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.955 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:43.956 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.957 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.958 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:43.960 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3568039
2023-04-17 19:43:43.961 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6196279
2023-04-17 19:43:43.962 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:43.963 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.965 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:43.968 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.970 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399&start=50
2023-04-17 19:43:43.971 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.972 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:43.973 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.974 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:43.975 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3568039
2023-04-17 19:43:43.976 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:43.982 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:43.983 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399&start=50
2023-04-17 19:43:44.085 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.087 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.088 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.089 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.090 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:44.093 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399&start=100
2023-04-17 19:43:44.094 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.095 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.097 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.098 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.099 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399&start=100
2023-04-17 19:43:44.215 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.215 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.218 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.223 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.232 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.240 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.256 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.257 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.263 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.271 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.275 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:44.279 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:44.280 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.282 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399&start=5650
2023-04-17 19:43:44.283 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399&start=5700
2023-04-17 19:43:44.284 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.285 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.286 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.287 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:44.288 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.289 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.292 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399&start=5750
2023-04-17 19:43:44.293 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.295 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.296 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.297 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.298 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.299 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.301 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399&start=5650
2023-04-17 19:43:44.302 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399&start=5700
2023-04-17 19:43:44.302 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.310 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.311 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399&start=5750
2023-04-17 19:43:44.341 +03:00 [INF] Application is shutting down...
2023-04-17 19:43:44.349 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.350 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.351 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.353 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.353 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:44.385 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.386 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.387 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.388 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.389 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:44.426 +03:00 [INF] Load finished in 723 ms
2023-04-17 19:43:44.427 +03:00 [INF] ProcessTargetPage was called 40 times
2023-04-17 19:43:44.428 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.429 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.432 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.433 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.452 +03:00 [INF] Load finished in 723 ms
2023-04-17 19:43:44.453 +03:00 [INF] ProcessTargetPage was called 41 times
2023-04-17 19:43:44.455 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.456 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.457 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.458 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.554 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.556 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.558 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.558 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.559 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:44.560 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:43:44.562 +03:00 [INF] ProcessTargetPage was called 42 times
2023-04-17 19:43:44.563 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.564 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.565 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.566 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.591 +03:00 [INF] Load finished in 731 ms
2023-04-17 19:43:44.592 +03:00 [INF] ProcessTargetPage was called 43 times
2023-04-17 19:43:44.594 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.595 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.595 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:43:44.596 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.597 +03:00 [INF] ProcessTargetPage was called 44 times
2023-04-17 19:43:44.598 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.599 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.601 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.603 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.605 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.662 +03:00 [INF] Load finished in 734 ms
2023-04-17 19:43:44.663 +03:00 [INF] ProcessTargetPage was called 45 times
2023-04-17 19:43:44.665 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.667 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.668 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.670 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.672 +03:00 [INF] Load finished in 720 ms
2023-04-17 19:43:44.673 +03:00 [INF] ProcessTargetPage was called 46 times
2023-04-17 19:43:44.675 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.676 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.678 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.679 +03:00 [INF] Load finished in 714 ms
2023-04-17 19:43:44.680 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.685 +03:00 [INF] Load finished in 734 ms
2023-04-17 19:43:44.684 +03:00 [INF] ProcessTargetPage was called 47 times
2023-04-17 19:43:44.686 +03:00 [INF] ProcessTargetPage was called 48 times
2023-04-17 19:43:44.687 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.688 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:44.690 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.691 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:44.692 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.693 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:44.694 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.697 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:44.818 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:44.819 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:44.821 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:44.821 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:44.823 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.023 +03:00 [INF] Load finished in 922 ms
2023-04-17 19:43:45.049 +03:00 [INF] Found 6 with pagination
2023-04-17 19:43:45.051 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.052 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.195 +03:00 [INF] Load finished in 1286 ms
2023-04-17 19:43:45.197 +03:00 [INF] ProcessTargetPage was called 49 times
2023-04-17 19:43:45.198 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:45.199 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:45.200 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:45.202 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:45.373 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.374 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.376 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.377 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.378 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.436 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.437 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.438 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.439 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.441 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.536 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.537 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.538 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.539 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.539 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.540 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.542 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.543 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.546 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.549 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.565 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.566 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.567 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.568 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.569 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.601 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.602 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.604 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.604 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.606 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.644 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.645 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.648 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.649 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.651 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.652 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.653 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.655 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.656 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.657 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:45.658 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.659 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:45.662 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:45.664 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.665 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:45.694 +03:00 [INF] Load finished in 1713 ms
2023-04-17 19:43:45.696 +03:00 [INF] ProcessTargetPage was called 50 times
2023-04-17 19:43:45.697 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:43:45.698 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:43:45.701 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:43:45.701 +03:00 [INF] Load finished in 1716 ms
2023-04-17 19:43:45.702 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:43:45.742 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:45.744 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:45.745 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:46.183 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:46.184 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:46.185 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:46.186 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:46.187 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:46.235 +03:00 [INF] Load finished in 1927 ms
2023-04-17 19:43:46.235 +03:00 [INF] Load finished in 1931 ms
2023-04-17 19:43:46.280 +03:00 [INF] Load finished in 1968 ms
2023-04-17 19:43:46.296 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:46.297 +03:00 [INF] Found 6 with pagination
2023-04-17 19:43:46.298 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:46.300 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:46.300 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:46.301 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:46.323 +03:00 [INF] Found 5 with pagination
2023-04-17 19:43:46.325 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:46.325 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:43:46.678 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:43:46.679 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:43:46.681 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:43:46.681 +03:00 [INF] Received 0 new jobs
2023-04-17 19:43:46.683 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:47:44.081 +03:00 [INF] Application started. Press Ctrl+C to shut down.
2023-04-17 19:47:44.081 +03:00 [INF] Start ScraperEngine.RunAsync
2023-04-17 19:47:44.129 +03:00 [INF] Hosting environment: Development
2023-04-17 19:47:44.130 +03:00 [INF] Content root path: C:\Projects\WebReaper\Examples\WebReaper.ScraperWorkerService
2023-04-17 19:47:44.132 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:44.134 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:44.142 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:44.149 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:44.198 +03:00 [INF] Scheduling the initial scraping job with start url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:47:44.200 +03:00 [INF] Start RedisScheduler.AddAsync
2023-04-17 19:47:44.209 +03:00 [INF] Start consuming the scraping jobs
2023-04-17 19:47:44.213 +03:00 [INF] Start RedisScheduler.GetAllAsync
2023-04-17 19:47:44.219 +03:00 [INF] Start crawling url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:47:44.250 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:44.251 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:44.252 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:44.254 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:44.261 +03:00 [INF] Loading static page https://rutracker.org/forum/index.php?c=33
2023-04-17 19:47:45.266 +03:00 [INF] Load finished in 1002 ms
2023-04-17 19:47:45.529 +03:00 [INF] Received 6 new jobs
2023-04-17 19:47:45.531 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:47:45.771 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:47:45.772 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:47:45.773 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:45.773 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:47:45.781 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:45.783 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:45.790 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:45.791 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:45.776 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:45.772 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:47:45.784 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:47:45.783 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:47:45.796 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:45.798 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:45.798 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:45.799 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:45.800 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:45.804 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:45.806 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:45.808 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:45.813 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:45.816 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:45.814 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:47:45.801 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:45.821 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:45.824 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:45.804 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:47:45.826 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:45.828 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:45.822 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:45.815 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:45.834 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:45.833 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:47:45.837 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:47:45.836 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:47:45.839 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:47:46.617 +03:00 [INF] Load finished in 777 ms
2023-04-17 19:47:46.621 +03:00 [INF] Load finished in 768 ms
2023-04-17 19:47:46.626 +03:00 [INF] Load finished in 782 ms
2023-04-17 19:47:46.648 +03:00 [INF] Received 4 new jobs
2023-04-17 19:47:46.651 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:47:46.656 +03:00 [INF] Received 6 new jobs
2023-04-17 19:47:46.657 +03:00 [INF] Received 4 new jobs
2023-04-17 19:47:46.658 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:47:46.659 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:47:46.726 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:47:46.726 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:47:46.728 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:47:46.730 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.735 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.739 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.729 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:47:46.746 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.758 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:47:46.755 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.767 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:47:46.765 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.769 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.729 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:47:46.774 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.775 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.727 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:47:46.778 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.777 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.782 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.780 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.780 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.727 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:47:46.727 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:47:46.728 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.728 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:47:46.743 +03:00 [INF] Load finished in 920 ms
2023-04-17 19:47:46.743 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:47:46.755 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:47:46.758 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.764 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:47:46.767 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.776 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.783 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.792 +03:00 [INF] Load finished in 963 ms
2023-04-17 19:47:46.784 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.785 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.801 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.805 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:47:46.786 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.807 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:47:46.815 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.808 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.787 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.822 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.788 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.823 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:47:46.824 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.825 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:47:46.826 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.830 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.834 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.792 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.793 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.839 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.838 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.841 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.844 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:47:46.846 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.845 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:47:46.842 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.849 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:47:46.800 +03:00 [INF] Received 8 new jobs
2023-04-17 19:47:46.856 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.794 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.795 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.796 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.797 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:46.862 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.861 +03:00 [INF] Start RedisScheduler.AddAsync with 8 jobs
2023-04-17 19:47:46.863 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.867 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:47:46.872 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.863 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.878 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.882 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.865 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:47:46.866 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:46.887 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:47:46.888 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.896 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:46.798 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.799 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.902 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:46.904 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:47:46.902 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:47:46.906 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:47:46.907 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:47:46.847 +03:00 [INF] Received 5 new jobs
2023-04-17 19:47:46.925 +03:00 [INF] Start RedisScheduler.AddAsync with 5 jobs
2023-04-17 19:47:47.085 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:47:47.086 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:47:47.086 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.086 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:47:47.086 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:47:47.087 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:47:47.088 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.089 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.090 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.092 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.091 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.096 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.098 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.099 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.091 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.102 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.104 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.095 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.106 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.108 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.107 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.111 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.114 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.109 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:47:47.113 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:47:47.118 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.116 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:47:47.110 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.127 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:47:47.132 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:47:47.171 +03:00 [INF] Load finished in 1322 ms
2023-04-17 19:47:47.179 +03:00 [INF] Received 3 new jobs
2023-04-17 19:47:47.180 +03:00 [INF] Start RedisScheduler.AddAsync with 3 jobs
2023-04-17 19:47:47.184 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:47:47.185 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.186 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.188 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.190 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.191 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:47:47.689 +03:00 [INF] Load finished in 880 ms
2023-04-17 19:47:47.716 +03:00 [INF] Load finished in 885 ms
2023-04-17 19:47:47.779 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:47.784 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:47.785 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:47.796 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:47:47.797 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.798 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.799 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.801 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.803 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:47:47.826 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:47.830 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:47.833 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:47.869 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:47:47.870 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:47.873 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:47.876 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:47.878 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:47.881 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:47:47.965 +03:00 [INF] Load finished in 1108 ms
2023-04-17 19:47:47.980 +03:00 [INF] Load finished in 1106 ms
2023-04-17 19:47:47.986 +03:00 [INF] Load finished in 1135 ms
2023-04-17 19:47:48.023 +03:00 [INF] Load finished in 1111 ms
2023-04-17 19:47:48.024 +03:00 [INF] Load finished in 1108 ms
2023-04-17 19:47:48.025 +03:00 [INF] Load finished in 1136 ms
2023-04-17 19:47:48.047 +03:00 [INF] Load finished in 1126 ms
2023-04-17 19:47:48.082 +03:00 [INF] Load finished in 963 ms
2023-04-17 19:47:48.094 +03:00 [INF] Load finished in 1267 ms
2023-04-17 19:47:48.121 +03:00 [INF] Load finished in 987 ms
2023-04-17 19:47:48.218 +03:00 [INF] Found 9 with pagination
2023-04-17 19:47:48.219 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.221 +03:00 [INF] Received 59 new jobs
2023-04-17 19:47:48.222 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.222 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:47:48.225 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.249 +03:00 [INF] Load finished in 1056 ms
2023-04-17 19:47:48.277 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=396
2023-04-17 19:47:48.278 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2322
2023-04-17 19:47:48.279 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.279 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.302 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.304 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.307 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.320 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.322 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.323 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.323 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.324 +03:00 [INF] Received 0 new jobs
2023-04-17 19:47:48.336 +03:00 [INF] Received 0 new jobs
2023-04-17 19:47:48.339 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:47:48.341 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:47:48.344 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2167
2023-04-17 19:47:48.346 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1993
2023-04-17 19:47:48.348 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.336 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.352 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.353 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.353 +03:00 [INF] Load finished in 1456 ms
2023-04-17 19:47:48.386 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.390 +03:00 [INF] Found 8 with pagination
2023-04-17 19:47:48.390 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.387 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.386 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.398 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.355 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.402 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.432 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.421 +03:00 [INF] Received 58 new jobs
2023-04-17 19:47:48.422 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.423 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.425 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.437 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.438 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.439 +03:00 [INF] Received 0 new jobs
2023-04-17 19:47:48.440 +03:00 [INF] Start RedisScheduler.AddAsync with 58 jobs
2023-04-17 19:47:48.466 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.473 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:47:48.471 +03:00 [INF] Received 0 new jobs
2023-04-17 19:47:48.467 +03:00 [INF] Load finished in 1329 ms
2023-04-17 19:47:48.482 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:47:48.467 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.473 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.468 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.469 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.504 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.505 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3184982
2023-04-17 19:47:48.505 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.513 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.514 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.488 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:47:48.513 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.520 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.521 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.527 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.526 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6072471
2023-04-17 19:47:48.521 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6072483
2023-04-17 19:47:48.525 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.473 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2321
2023-04-17 19:47:48.470 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.488 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:47:48.481 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:47:48.551 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.552 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.567 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.554 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4427898
2023-04-17 19:47:48.555 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.573 +03:00 [INF] Found 7 with pagination
2023-04-17 19:47:48.569 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3184982
2023-04-17 19:47:48.573 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.576 +03:00 [INF] Received 57 new jobs
2023-04-17 19:47:48.580 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.590 +03:00 [INF] Start RedisScheduler.AddAsync with 57 jobs
2023-04-17 19:47:48.592 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.574 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.556 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4427882
2023-04-17 19:47:48.597 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.595 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.572 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.599 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.602 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4427898
2023-04-17 19:47:48.604 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:47:48.598 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.606 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6072471
2023-04-17 19:47:48.556 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.611 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.615 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.619 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.562 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.563 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.623 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.622 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.637 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4427882
2023-04-17 19:47:48.639 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.634 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.565 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.646 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.644 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6072483
2023-04-17 19:47:48.565 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.650 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.650 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.655 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.566 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.610 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4427872
2023-04-17 19:47:48.653 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4427100
2023-04-17 19:47:48.653 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.648 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.656 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.660 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.658 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.655 +03:00 [INF] Received 0 new jobs
2023-04-17 19:47:48.657 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.657 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.671 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.668 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.670 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:47:48.675 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4427093
2023-04-17 19:47:48.668 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.674 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.681 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.678 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4427083
2023-04-17 19:47:48.678 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4427077
2023-04-17 19:47:48.683 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:47:48.676 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.683 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:47:48.684 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.685 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.687 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.684 +03:00 [INF] Load finished in 879 ms
2023-04-17 19:47:48.691 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.673 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.698 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.699 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.700 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.707 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.709 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.706 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.703 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4427100
2023-04-17 19:47:48.713 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.715 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4427093
2023-04-17 19:47:48.712 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.718 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4427077
2023-04-17 19:47:48.704 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.722 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4427083
2023-04-17 19:47:48.725 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.733 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4427872
2023-04-17 19:47:48.756 +03:00 [INF] Load finished in 1938 ms
2023-04-17 19:47:48.784 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:48.799 +03:00 [INF] Load finished in 1891 ms
2023-04-17 19:47:48.799 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:48.801 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:48.815 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4426809
2023-04-17 19:47:48.816 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.817 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.819 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.823 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.825 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4426809
2023-04-17 19:47:48.850 +03:00 [INF] Found 1 with pagination
2023-04-17 19:47:48.851 +03:00 [INF] Received 51 new jobs
2023-04-17 19:47:48.852 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:47:48.864 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4423386
2023-04-17 19:47:48.864 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.865 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.867 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.869 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.871 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4423386
2023-04-17 19:47:48.883 +03:00 [INF] Found 9 with pagination
2023-04-17 19:47:48.886 +03:00 [INF] Received 59 new jobs
2023-04-17 19:47:48.887 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:47:48.899 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4596976
2023-04-17 19:47:48.900 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:48.901 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:48.903 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:48.905 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:48.911 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4596976
2023-04-17 19:47:49.156 +03:00 [INF] Load finished in 1266 ms
2023-04-17 19:47:49.222 +03:00 [INF] Load finished in 2095 ms
2023-04-17 19:47:49.224 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:49.226 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:49.227 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:49.239 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4596968
2023-04-17 19:47:49.240 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:49.241 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:49.244 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:49.246 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:49.248 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4596968
2023-04-17 19:47:49.306 +03:00 [INF] Load finished in 730 ms
2023-04-17 19:47:49.311 +03:00 [INF] Found 5 with pagination
2023-04-17 19:47:49.313 +03:00 [INF] Received 55 new jobs
2023-04-17 19:47:49.313 +03:00 [INF] ProcessTargetPage was called 1 times
2023-04-17 19:47:49.314 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:47:49.315 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:49.317 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:49.319 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:49.320 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:49.326 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:47:49.328 +03:00 [INF] ProcessTargetPage was called 2 times
2023-04-17 19:47:49.330 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:49.331 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4596960
2023-04-17 19:47:49.331 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:49.332 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:49.334 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:49.334 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:49.336 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:49.338 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:49.341 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:49.342 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4596960
2023-04-17 19:47:49.345 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:47:49.348 +03:00 [INF] ProcessTargetPage was called 3 times
2023-04-17 19:47:49.349 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:47:49.350 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:47:49.351 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:47:49.352 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:47:49.399 +03:00 [INF] Load finished in 758 ms
2023-04-17 19:48:00.145 +03:00 [INF] Load finished in 11494 ms
2023-04-17 19:48:00.151 +03:00 [INF] ProcessTargetPage was called 4 times
2023-04-17 19:48:00.164 +03:00 [INF] ProcessTargetPage was called 5 times
2023-04-17 19:48:00.170 +03:00 [INF] Load finished in 11451 ms
2023-04-17 19:48:00.170 +03:00 [INF] Load finished in 11436 ms
2023-04-17 19:48:00.170 +03:00 [INF] Load finished in 11454 ms
2023-04-17 19:48:00.170 +03:00 [INF] Load finished in 11447 ms
2023-04-17 19:48:00.170 +03:00 [INF] Load finished in 11343 ms
2023-04-17 19:48:00.170 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector div.attach_link.guest>ul>li:nth-child(2).
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:00.170 +03:00 [INF] Load finished in 11441 ms
2023-04-17 19:48:00.170 +03:00 [INF] Load finished in 11562 ms
2023-04-17 19:48:00.178 +03:00 [INF] ProcessTargetPage was called 10 times
2023-04-17 19:48:00.946 +03:00 [INF] ProcessTargetPage was called 11 times
2023-04-17 19:48:00.958 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .magnet-link.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:00.960 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:07.592 +03:00 [INF] Start ScraperEngine.RunAsync
2023-04-17 19:48:07.592 +03:00 [INF] Application started. Press Ctrl+C to shut down.
2023-04-17 19:48:07.641 +03:00 [INF] Hosting environment: Development
2023-04-17 19:48:07.642 +03:00 [INF] Content root path: C:\Projects\WebReaper\Examples\WebReaper.ScraperWorkerService
2023-04-17 19:48:07.642 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:07.644 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:07.646 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:07.653 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:07.697 +03:00 [INF] Scheduling the initial scraping job with start url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:48:07.700 +03:00 [INF] Start RedisScheduler.AddAsync
2023-04-17 19:48:07.709 +03:00 [INF] Start consuming the scraping jobs
2023-04-17 19:48:07.713 +03:00 [INF] Start RedisScheduler.GetAllAsync
2023-04-17 19:48:07.719 +03:00 [INF] Start crawling url https://rutracker.org/forum/index.php?c=33
2023-04-17 19:48:07.737 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:07.738 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:07.739 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:07.741 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:07.749 +03:00 [INF] Loading static page https://rutracker.org/forum/index.php?c=33
2023-04-17 19:48:08.630 +03:00 [INF] Load finished in 878 ms
2023-04-17 19:48:08.929 +03:00 [INF] Received 6 new jobs
2023-04-17 19:48:08.932 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:48:08.957 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:48:08.958 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:48:08.958 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:48:08.958 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:48:08.959 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:08.959 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:48:08.960 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:08.960 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:48:08.961 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:08.962 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:08.963 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:08.964 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:08.965 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:08.966 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:08.968 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:08.969 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:08.970 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:08.971 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:08.972 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:08.975 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:08.976 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:08.977 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:08.978 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:08.979 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:08.980 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:08.982 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:08.983 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:08.984 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:08.985 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=395
2023-04-17 19:48:08.986 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:08.987 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2326
2023-04-17 19:48:08.991 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:08.992 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2389
2023-04-17 19:48:08.993 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2327
2023-04-17 19:48:08.995 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2324
2023-04-17 19:48:08.997 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2328
2023-04-17 19:48:09.765 +03:00 [INF] Load finished in 767 ms
2023-04-17 19:48:09.770 +03:00 [INF] Load finished in 770 ms
2023-04-17 19:48:09.770 +03:00 [INF] Load finished in 774 ms
2023-04-17 19:48:09.780 +03:00 [INF] Load finished in 781 ms
2023-04-17 19:48:09.781 +03:00 [INF] Received 4 new jobs
2023-04-17 19:48:09.782 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:48:09.784 +03:00 [INF] Received 6 new jobs
2023-04-17 19:48:09.785 +03:00 [INF] Received 3 new jobs
2023-04-17 19:48:09.786 +03:00 [INF] Start RedisScheduler.AddAsync with 6 jobs
2023-04-17 19:48:09.787 +03:00 [INF] Start RedisScheduler.AddAsync with 3 jobs
2023-04-17 19:48:09.788 +03:00 [INF] Received 8 new jobs
2023-04-17 19:48:09.790 +03:00 [INF] Load finished in 790 ms
2023-04-17 19:48:09.792 +03:00 [INF] Start RedisScheduler.AddAsync with 8 jobs
2023-04-17 19:48:09.797 +03:00 [INF] Received 4 new jobs
2023-04-17 19:48:09.797 +03:00 [INF] Start RedisScheduler.AddAsync with 4 jobs
2023-04-17 19:48:09.894 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:48:09.894 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:48:09.894 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:48:09.895 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:48:09.895 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:48:09.895 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:48:09.895 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.895 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:48:09.896 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:48:09.896 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.897 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:48:09.897 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:48:09.897 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.897 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:48:09.898 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:48:09.898 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:48:09.898 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.899 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:48:09.899 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:48:09.899 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:48:09.899 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.900 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.901 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.902 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.904 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.905 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.906 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.907 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.908 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.910 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.911 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.912 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.913 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.914 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.915 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.916 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.917 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.918 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.919 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.920 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.921 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.923 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:48:09.923 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.924 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.929 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.930 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.931 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.931 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.933 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.933 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.935 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.936 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.937 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:48:09.938 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.939 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.942 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.943 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.945 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.946 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:48:09.947 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.948 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.949 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.951 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.952 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.953 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.955 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.960 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.961 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.962 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.963 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.965 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.966 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.967 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.968 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.969 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:09.971 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.974 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.976 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.977 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.978 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.979 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388
2023-04-17 19:48:09.980 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.982 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.983 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.984 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.985 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.986 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2387
2023-04-17 19:48:09.990 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.991 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.992 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:09.993 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:09.994 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661
2023-04-17 19:48:09.995 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:09.996 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2348
2023-04-17 19:48:09.997 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1350
2023-04-17 19:48:09.997 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=403
2023-04-17 19:48:09.997 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1279
2023-04-17 19:48:09.999 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=716
2023-04-17 19:48:10.000 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2165
2023-04-17 19:48:10.001 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=401
2023-04-17 19:48:10.002 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=574
2023-04-17 19:48:10.005 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:10.005 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=1036
2023-04-17 19:48:10.007 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=400
2023-04-17 19:48:10.008 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=695
2023-04-17 19:48:10.009 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=399
2023-04-17 19:48:10.010 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=402
2023-04-17 19:48:10.011 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:10.013 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:10.026 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:10.035 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:10.036 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=467
2023-04-17 19:48:10.037 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=490
2023-04-17 19:48:10.037 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=499
2023-04-17 19:48:10.603 +03:00 [INF] Load finished in 1609 ms
2023-04-17 19:48:10.620 +03:00 [INF] Received 5 new jobs
2023-04-17 19:48:10.622 +03:00 [INF] Start RedisScheduler.AddAsync with 5 jobs
2023-04-17 19:48:10.625 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:48:10.626 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:10.628 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:10.630 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:10.631 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:10.632 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2137
2023-04-17 19:48:10.922 +03:00 [INF] Load finished in 910 ms
2023-04-17 19:48:10.957 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:10.962 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:10.963 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:10.973 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:48:10.974 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:10.975 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:10.976 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:10.977 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:10.978 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2127
2023-04-17 19:48:11.048 +03:00 [INF] Load finished in 1048 ms
2023-04-17 19:48:11.055 +03:00 [INF] Load finished in 1048 ms
2023-04-17 19:48:11.069 +03:00 [INF] Load finished in 1054 ms
2023-04-17 19:48:11.069 +03:00 [INF] Load finished in 1055 ms
2023-04-17 19:48:11.111 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:11.114 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:11.133 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:11.139 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:11.141 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:11.142 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:11.144 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:48:11.145 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.146 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.148 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.149 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.150 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2325
2023-04-17 19:48:11.168 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:48:11.169 +03:00 [INF] Found 9 with pagination
2023-04-17 19:48:11.170 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.173 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.173 +03:00 [INF] Received 59 new jobs
2023-04-17 19:48:11.178 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.178 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:48:11.180 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.182 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2342
2023-04-17 19:48:11.184 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:11.187 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:11.189 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:11.190 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:48:11.191 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.192 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.194 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.195 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.196 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=530
2023-04-17 19:48:11.198 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:48:11.201 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.202 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.203 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.204 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.205 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2152
2023-04-17 19:48:11.884 +03:00 [INF] Load finished in 1868 ms
2023-04-17 19:48:11.913 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:11.915 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:11.916 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:11.925 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=396
2023-04-17 19:48:11.926 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.927 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.929 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.930 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.931 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:11.932 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:11.933 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2322
2023-04-17 19:48:11.934 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.936 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.937 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.938 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.941 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:11.942 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:11.944 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2167
2023-04-17 19:48:11.945 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.946 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.948 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.950 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.950 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:11.951 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:11.953 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=1993
2023-04-17 19:48:11.956 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.959 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.961 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.962 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.963 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:11.965 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:11.967 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2321
2023-04-17 19:48:11.969 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.970 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.973 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.974 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.976 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:11.977 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:11.979 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6299167
2023-04-17 19:48:11.980 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:11.981 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:11.982 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:11.982 +03:00 [INF] Load finished in 1965 ms
2023-04-17 19:48:11.983 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:11.986 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6299167
2023-04-17 19:48:12.011 +03:00 [INF] Found 9 with pagination
2023-04-17 19:48:12.013 +03:00 [INF] Received 59 new jobs
2023-04-17 19:48:12.014 +03:00 [INF] Start RedisScheduler.AddAsync with 59 jobs
2023-04-17 19:48:12.024 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6307446
2023-04-17 19:48:12.025 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:12.026 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:12.027 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:12.028 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:12.029 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6307446
2023-04-17 19:48:12.122 +03:00 [INF] Load finished in 2098 ms
2023-04-17 19:48:12.125 +03:00 [INF] Load finished in 2100 ms
2023-04-17 19:48:12.134 +03:00 [INF] Load finished in 2112 ms
2023-04-17 19:48:12.158 +03:00 [INF] Load finished in 2134 ms
2023-04-17 19:48:12.208 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:12.211 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:12.211 +03:00 [INF] Found 7 with pagination
2023-04-17 19:48:12.211 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:12.227 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:12.227 +03:00 [INF] Received 57 new jobs
2023-04-17 19:48:12.230 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:12.230 +03:00 [INF] Start RedisScheduler.AddAsync with 57 jobs
2023-04-17 19:48:12.231 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:12.235 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:12.237 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6337849
2023-04-17 19:48:12.237 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:12.240 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:12.241 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:12.242 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:12.243 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5784362
2023-04-17 19:48:12.244 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6352160
2023-04-17 19:48:12.245 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:12.246 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:12.247 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:12.249 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:12.249 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:12.251 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:12.252 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6352156
2023-04-17 19:48:12.252 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6337849
2023-04-17 19:48:12.255 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:12.256 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:12.257 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:12.259 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:12.260 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:12.261 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:12.263 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5784362
2023-04-17 19:48:12.264 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6352160
2023-04-17 19:48:12.264 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:12.268 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:12.269 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6352156
2023-04-17 19:48:12.947 +03:00 [INF] Load finished in 2919 ms
2023-04-17 19:48:12.981 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:12.984 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:12.984 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:12.994 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6336645
2023-04-17 19:48:12.995 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:12.996 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:12.998 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:12.999 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.001 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6336645
2023-04-17 19:48:13.001 +03:00 [INF] Load finished in 2970 ms
2023-04-17 19:48:13.047 +03:00 [INF] Load finished in 3015 ms
2023-04-17 19:48:13.049 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:13.051 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:13.053 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:13.062 +03:00 [INF] Load finished in 3033 ms
2023-04-17 19:48:13.071 +03:00 [INF] Load finished in 3032 ms
2023-04-17 19:48:13.072 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6341924
2023-04-17 19:48:13.073 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.075 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.076 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.078 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.088 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:13.089 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6341924
2023-04-17 19:48:13.090 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:13.092 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:13.110 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5929358
2023-04-17 19:48:13.111 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.120 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:13.120 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.121 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:13.122 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:13.123 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.125 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:13.126 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:13.127 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.128 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:13.132 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5929358
2023-04-17 19:48:13.140 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6213428
2023-04-17 19:48:13.141 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.142 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.143 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.144 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6217062
2023-04-17 19:48:13.145 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.148 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.150 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6213428
2023-04-17 19:48:13.151 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.154 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.155 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.157 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6217062
2023-04-17 19:48:13.497 +03:00 [INF] Load finished in 3467 ms
2023-04-17 19:48:13.547 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:13.549 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:13.550 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:13.559 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6304649
2023-04-17 19:48:13.560 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.561 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.562 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.563 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.564 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6304649
2023-04-17 19:48:13.857 +03:00 [INF] Load finished in 1581 ms
2023-04-17 19:48:13.860 +03:00 [INF] Load finished in 1593 ms
2023-04-17 19:48:13.862 +03:00 [INF] Load finished in 1604 ms
2023-04-17 19:48:13.865 +03:00 [INF] ProcessTargetPage was called 1 times
2023-04-17 19:48:13.866 +03:00 [INF] ProcessTargetPage was called 2 times
2023-04-17 19:48:13.866 +03:00 [INF] ProcessTargetPage was called 3 times
2023-04-17 19:48:13.869 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.870 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.872 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.873 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.875 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.876 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.877 +03:00 [INF] Load finished in 875 ms
2023-04-17 19:48:13.877 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.878 +03:00 [INF] Load finished in 787 ms
2023-04-17 19:48:13.878 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.879 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.880 +03:00 [INF] ProcessTargetPage was called 4 times
2023-04-17 19:48:13.883 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.884 +03:00 [INF] ProcessTargetPage was called 5 times
2023-04-17 19:48:13.885 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.886 +03:00 [INF] Load finished in 733 ms
2023-04-17 19:48:13.886 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.888 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.891 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.893 +03:00 [INF] ProcessTargetPage was called 6 times
2023-04-17 19:48:13.894 +03:00 [INF] Load finished in 736 ms
2023-04-17 19:48:13.895 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.896 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.900 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.902 +03:00 [INF] ProcessTargetPage was called 7 times
2023-04-17 19:48:13.904 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.905 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.906 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.908 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:13.910 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.912 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.915 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.917 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:13.920 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.922 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:13.924 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:13.958 +03:00 [INF] Load finished in 3324 ms
2023-04-17 19:48:13.985 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:13.987 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:13.988 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:13.997 +03:00 [INF] Load finished in 2006 ms
2023-04-17 19:48:13.998 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351967
2023-04-17 19:48:13.999 +03:00 [INF] ProcessTargetPage was called 8 times
2023-04-17 19:48:14.000 +03:00 [INF] Load finished in 2817 ms
2023-04-17 19:48:14.001 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.002 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.005 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.006 +03:00 [INF] Load finished in 3967 ms
2023-04-17 19:48:14.008 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.010 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.013 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.014 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.020 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.021 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351967
2023-04-17 19:48:14.037 +03:00 [INF] Load finished in 2007 ms
2023-04-17 19:48:14.037 +03:00 [INF] Load finished in 2830 ms
2023-04-17 19:48:14.052 +03:00 [INF] Load finished in 916 ms
2023-04-17 19:48:14.054 +03:00 [INF] ProcessTargetPage was called 9 times
2023-04-17 19:48:14.054 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector div.attach_link.guest>ul>li:nth-child(2).
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.056 +03:00 [INF] Found 1 with pagination
2023-04-17 19:48:14.087 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .magnet-link.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.059 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.059 +03:00 [INF] Load finished in 4018 ms
2023-04-17 19:48:14.077 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:14.057 +03:00 [INF] ProcessTargetPage was called 10 times
2023-04-17 19:48:14.088 +03:00 [INF] Received 51 new jobs
2023-04-17 19:48:14.104 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.104 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:14.104 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.107 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:14.108 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.109 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:48:14.114 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:14.115 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.119 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:14.120 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.133 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:14.135 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.138 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:14.138 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.142 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351964
2023-04-17 19:48:14.144 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:14.145 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.147 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6349836
2023-04-17 19:48:14.149 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.149 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector div.attach_link.guest>ul>li:nth-child(2).
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.150 +03:00 [INF] Load finished in 2999 ms
2023-04-17 19:48:14.150 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:14.151 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6348526
2023-04-17 19:48:14.153 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.156 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.171 +03:00 [INF] Load finished in 2973 ms
2023-04-17 19:48:14.171 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .magnet-link.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.175 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.178 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.181 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.184 +03:00 [INF] Load finished in 1918 ms
2023-04-17 19:48:14.185 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .postImg.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.196 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6343486
2023-04-17 19:48:14.196 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.197 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.199 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.199 +03:00 [INF] ProcessTargetPage was called 11 times
2023-04-17 19:48:14.202 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.203 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.204 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:14.204 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.206 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351964
2023-04-17 19:48:14.218 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.219 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.221 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.222 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:14.223 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6349836
2023-04-17 19:48:14.225 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.227 +03:00 [INF] Found 8 with pagination
2023-04-17 19:48:14.227 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.228 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6348526
2023-04-17 19:48:14.229 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:14.231 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.233 +03:00 [INF] Received 58 new jobs
2023-04-17 19:48:14.233 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.237 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.239 +03:00 [INF] Start RedisScheduler.AddAsync with 58 jobs
2023-04-17 19:48:14.242 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6343486
2023-04-17 19:48:14.246 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6349424
2023-04-17 19:48:14.250 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.252 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.253 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.267 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.269 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6349424
2023-04-17 19:48:14.269 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector div.attach_link.guest>ul>li:nth-child(2).
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.270 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6291762
2023-04-17 19:48:14.277 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.278 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.280 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.281 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.281 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:48:14.283 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6291762
2023-04-17 19:48:14.284 +03:00 [INF] ProcessTargetPage was called 12 times
2023-04-17 19:48:14.287 +03:00 [ERR] Error during parsing phase
System.InvalidOperationException: Cannot find element by selector .magnet-link.
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.GetData(IDocument doc, SchemaElement el) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 90
   at WebReaper.Core.Parser.Concrete.AngleSharpContentParser.FillOutput(JObject result, IDocument doc, SchemaElement item) in C:\Projects\WebReaper\WebReaper\Core\Parser\Concrete\AngleSharpContentParser.cs:line 61
2023-04-17 19:48:14.288 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.290 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.292 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.293 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.743 +03:00 [INF] Load finished in 717 ms
2023-04-17 19:48:14.745 +03:00 [INF] ProcessTargetPage was called 13 times
2023-04-17 19:48:14.747 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.757 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.759 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.760 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.905 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:14.905 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:14.906 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:14.907 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:14.911 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:14.912 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:14.914 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:14.914 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:14.914 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:14.914 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:14.915 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:14.915 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:14.916 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:14.917 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:14.918 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:14.918 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:14.919 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:14.919 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:14.920 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:14.922 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351555
2023-04-17 19:48:14.922 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:14.923 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:14.924 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:14.926 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351749
2023-04-17 19:48:14.931 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351560
2023-04-17 19:48:14.931 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.932 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:14.933 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:14.934 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:14.935 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.936 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.937 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.937 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:14.938 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:14.939 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:14.940 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.941 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.944 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.945 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:14.947 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351545
2023-04-17 19:48:14.948 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:14.948 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:48:14.949 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.950 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.951 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.953 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351543
2023-04-17 19:48:14.953 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.955 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6342525
2023-04-17 19:48:14.959 +03:00 [INF] ProcessTargetPage was called 14 times
2023-04-17 19:48:14.963 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.964 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.965 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351555
2023-04-17 19:48:14.965 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.966 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.968 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.969 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:14.970 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351749
2023-04-17 19:48:14.971 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351560
2023-04-17 19:48:14.974 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.975 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.976 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.977 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:14.980 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.981 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.983 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.985 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:14.986 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.987 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351545
2023-04-17 19:48:14.988 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.993 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:14.994 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351543
2023-04-17 19:48:14.996 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6342525
2023-04-17 19:48:14.999 +03:00 [INF] Load finished in 714 ms
2023-04-17 19:48:15.001 +03:00 [INF] ProcessTargetPage was called 15 times
2023-04-17 19:48:15.002 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.003 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.005 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.007 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.220 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:15.221 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:15.223 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:15.223 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:15.225 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:15.253 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5420098
2023-04-17 19:48:15.253 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.254 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.254 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:15.260 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.261 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:15.262 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.263 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:15.264 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5420098
2023-04-17 19:48:15.264 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:15.266 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:15.267 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6302793
2023-04-17 19:48:15.268 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.269 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.273 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.274 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.276 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6302793
2023-04-17 19:48:15.326 +03:00 [INF] Load finished in 4347 ms
2023-04-17 19:48:15.353 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:15.355 +03:00 [INF] Received 55 new jobs
2023-04-17 19:48:15.356 +03:00 [INF] Start RedisScheduler.AddAsync with 55 jobs
2023-04-17 19:48:15.365 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6332167
2023-04-17 19:48:15.366 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.367 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.368 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.369 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.370 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6332167
2023-04-17 19:48:15.468 +03:00 [INF] Load finished in 1244 ms
2023-04-17 19:48:15.469 +03:00 [INF] ProcessTargetPage was called 16 times
2023-04-17 19:48:15.470 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.471 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.472 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.473 +03:00 [INF] Load finished in 1238 ms
2023-04-17 19:48:15.473 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.474 +03:00 [INF] ProcessTargetPage was called 17 times
2023-04-17 19:48:15.476 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.477 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.479 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.480 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.505 +03:00 [INF] Load finished in 1234 ms
2023-04-17 19:48:15.506 +03:00 [INF] ProcessTargetPage was called 18 times
2023-04-17 19:48:15.507 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.508 +03:00 [INF] Load finished in 1258 ms
2023-04-17 19:48:15.508 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.509 +03:00 [INF] ProcessTargetPage was called 19 times
2023-04-17 19:48:15.510 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.511 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.513 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.513 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.515 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.525 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.683 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:15.684 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:15.685 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:15.686 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:15.687 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:15.688 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6346480
2023-04-17 19:48:15.689 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.690 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:48:15.690 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.692 +03:00 [INF] ProcessTargetPage was called 20 times
2023-04-17 19:48:15.692 +03:00 [INF] Load finished in 714 ms
2023-04-17 19:48:15.693 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.694 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.695 +03:00 [INF] ProcessTargetPage was called 21 times
2023-04-17 19:48:15.696 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.697 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.698 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.699 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6346480
2023-04-17 19:48:15.699 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.700 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.702 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.703 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.721 +03:00 [INF] Load finished in 741 ms
2023-04-17 19:48:15.721 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:48:15.721 +03:00 [INF] Load finished in 723 ms
2023-04-17 19:48:15.723 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:15.723 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.724 +03:00 [INF] ProcessTargetPage was called 22 times
2023-04-17 19:48:15.725 +03:00 [INF] ProcessTargetPage was called 23 times
2023-04-17 19:48:15.726 +03:00 [INF] ProcessTargetPage was called 24 times
2023-04-17 19:48:15.727 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:15.729 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:48:15.730 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.731 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.732 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.733 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:15.734 +03:00 [INF] ProcessTargetPage was called 25 times
2023-04-17 19:48:15.735 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.736 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.737 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.741 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:15.742 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.744 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.745 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.746 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.748 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:15.750 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.751 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.754 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.756 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.758 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351283
2023-04-17 19:48:15.760 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.766 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.772 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.773 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.774 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.776 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.777 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351283
2023-04-17 19:48:15.952 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:15.953 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:15.955 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:15.957 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:15.958 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:15.960 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351269
2023-04-17 19:48:15.961 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.961 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.962 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:15.963 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.963 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:15.965 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.966 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:15.967 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351269
2023-04-17 19:48:15.967 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:15.971 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:15.973 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351261
2023-04-17 19:48:15.974 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.975 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.977 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:15.978 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:15.979 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351261
2023-04-17 19:48:15.988 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:15.989 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:15.991 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:15.992 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:15.993 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:15.995 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6349646
2023-04-17 19:48:15.996 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:15.997 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:15.998 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.002 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.004 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6349646
2023-04-17 19:48:16.085 +03:00 [INF] Load finished in 714 ms
2023-04-17 19:48:16.086 +03:00 [INF] ProcessTargetPage was called 26 times
2023-04-17 19:48:16.088 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.089 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.090 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.091 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.139 +03:00 [INF] Load finished in 873 ms
2023-04-17 19:48:16.140 +03:00 [INF] ProcessTargetPage was called 27 times
2023-04-17 19:48:16.143 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.144 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.145 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.147 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.186 +03:00 [INF] Load finished in 909 ms
2023-04-17 19:48:16.187 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.188 +03:00 [INF] ProcessTargetPage was called 28 times
2023-04-17 19:48:16.189 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.190 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.192 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.193 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.194 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.196 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.198 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.199 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.201 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6295587
2023-04-17 19:48:16.208 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.209 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.210 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.212 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.213 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6295587
2023-04-17 19:48:16.413 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.414 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.415 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.416 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.417 +03:00 [INF] Load finished in 715 ms
2023-04-17 19:48:16.417 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.418 +03:00 [INF] ProcessTargetPage was called 29 times
2023-04-17 19:48:16.422 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6347062
2023-04-17 19:48:16.425 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.426 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.428 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.430 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.431 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.432 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.434 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.438 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.440 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6347062
2023-04-17 19:48:16.441 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.442 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.443 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.444 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.445 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.447 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351086
2023-04-17 19:48:16.448 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.449 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.450 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.455 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.456 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.456 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351086
2023-04-17 19:48:16.457 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.459 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.459 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.460 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.462 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351070
2023-04-17 19:48:16.463 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.464 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.467 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.468 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.469 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351070
2023-04-17 19:48:16.488 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.488 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.489 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.490 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.491 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.493 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351066
2023-04-17 19:48:16.494 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.495 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.496 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.500 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.501 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351066
2023-04-17 19:48:16.525 +03:00 [INF] Load finished in 747 ms
2023-04-17 19:48:16.526 +03:00 [INF] ProcessTargetPage was called 30 times
2023-04-17 19:48:16.530 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.531 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.531 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.533 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.534 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.535 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.536 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.550 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.551 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.553 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6350620
2023-04-17 19:48:16.554 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.556 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.558 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.560 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.561 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6350620
2023-04-17 19:48:16.654 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.655 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.656 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.657 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.659 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.663 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6209544
2023-04-17 19:48:16.664 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.665 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.667 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.670 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.671 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6209544
2023-04-17 19:48:16.694 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.695 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.696 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.697 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.698 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.699 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:48:16.700 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6332745
2023-04-17 19:48:16.701 +03:00 [INF] ProcessTargetPage was called 31 times
2023-04-17 19:48:16.712 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.713 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.714 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.714 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.714 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.715 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:16.721 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.716 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.718 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.719 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.720 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:16.715 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.722 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.723 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.724 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.725 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.726 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:16.726 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.727 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.728 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.729 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.730 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.734 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:16.735 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.736 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.737 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.738 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.740 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:16.741 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6332745
2023-04-17 19:48:16.743 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6239740
2023-04-17 19:48:16.751 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.745 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6317116
2023-04-17 19:48:16.746 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6317126
2023-04-17 19:48:16.749 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6340851
2023-04-17 19:48:16.743 +03:00 [INF] Load finished in 738 ms
2023-04-17 19:48:16.751 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.753 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.753 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.754 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.756 +03:00 [INF] ProcessTargetPage was called 32 times
2023-04-17 19:48:16.757 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.758 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.759 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.760 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.761 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.768 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.769 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.770 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.771 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.772 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.774 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6239740
2023-04-17 19:48:16.775 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.777 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.779 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.781 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.786 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6317116
2023-04-17 19:48:16.788 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6317126
2023-04-17 19:48:16.789 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6340851
2023-04-17 19:48:16.791 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:16.844 +03:00 [INF] Load finished in 875 ms
2023-04-17 19:48:16.846 +03:00 [INF] ProcessTargetPage was called 33 times
2023-04-17 19:48:16.847 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:16.848 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:16.849 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:16.851 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.050 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.051 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.052 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.053 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.054 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.056 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6346401
2023-04-17 19:48:17.057 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.058 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.060 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.061 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.062 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6346401
2023-04-17 19:48:17.131 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.132 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.134 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.134 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.135 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.137 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6350118
2023-04-17 19:48:17.138 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.139 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.140 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.142 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.143 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6350118
2023-04-17 19:48:17.145 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.146 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.147 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.148 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.150 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.154 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6304965
2023-04-17 19:48:17.157 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.158 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.160 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.161 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:48:17.161 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.163 +03:00 [INF] ProcessTargetPage was called 34 times
2023-04-17 19:48:17.164 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6304965
2023-04-17 19:48:17.165 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.169 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.169 +03:00 [INF] Load finished in 711 ms
2023-04-17 19:48:17.171 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.172 +03:00 [INF] ProcessTargetPage was called 35 times
2023-04-17 19:48:17.174 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.175 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.177 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.178 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.180 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.186 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:48:17.187 +03:00 [INF] ProcessTargetPage was called 36 times
2023-04-17 19:48:17.188 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.189 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.190 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.191 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.233 +03:00 [INF] Load finished in 730 ms
2023-04-17 19:48:17.234 +03:00 [INF] ProcessTargetPage was called 37 times
2023-04-17 19:48:17.235 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.236 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.237 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.238 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.402 +03:00 [INF] Load finished in 730 ms
2023-04-17 19:48:17.404 +03:00 [INF] ProcessTargetPage was called 38 times
2023-04-17 19:48:17.407 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.408 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.410 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.411 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.412 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.413 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.415 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.416 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.417 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.419 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6344708
2023-04-17 19:48:17.421 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.422 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.424 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.425 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.426 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6344708
2023-04-17 19:48:17.478 +03:00 [INF] Load finished in 728 ms
2023-04-17 19:48:17.480 +03:00 [INF] ProcessTargetPage was called 39 times
2023-04-17 19:48:17.481 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.482 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.483 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.484 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.502 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:48:17.503 +03:00 [INF] ProcessTargetPage was called 40 times
2023-04-17 19:48:17.505 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.506 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.507 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.508 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.514 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:48:17.515 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:48:17.516 +03:00 [INF] ProcessTargetPage was called 41 times
2023-04-17 19:48:17.517 +03:00 [INF] ProcessTargetPage was called 42 times
2023-04-17 19:48:17.518 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.520 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.521 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.522 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.524 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.525 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.526 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.528 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.528 +03:00 [INF] Load finished in 729 ms
2023-04-17 19:48:17.544 +03:00 [INF] ProcessTargetPage was called 43 times
2023-04-17 19:48:17.545 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.547 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.548 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.549 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.550 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.552 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.553 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.556 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.559 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.565 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6017868
2023-04-17 19:48:17.566 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.568 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.569 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.570 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.571 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6017868
2023-04-17 19:48:17.699 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.700 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.702 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.702 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.704 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.705 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661&start=50
2023-04-17 19:48:17.706 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.707 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.708 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.710 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.711 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661&start=50
2023-04-17 19:48:17.733 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.734 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.736 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.737 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.738 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.741 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661&start=100
2023-04-17 19:48:17.742 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.742 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.744 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.745 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.746 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661&start=100
2023-04-17 19:48:17.818 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:17.819 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:17.820 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:17.821 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:17.822 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:17.824 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661&start=3900
2023-04-17 19:48:17.825 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.826 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.827 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.829 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.830 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661&start=3900
2023-04-17 19:48:17.882 +03:00 [INF] Load finished in 738 ms
2023-04-17 19:48:17.882 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:48:17.883 +03:00 [INF] ProcessTargetPage was called 44 times
2023-04-17 19:48:17.885 +03:00 [INF] ProcessTargetPage was called 45 times
2023-04-17 19:48:17.886 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.887 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:17.888 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.889 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:17.890 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.891 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:17.893 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:17.894 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.053 +03:00 [INF] Load finished in 1839 ms
2023-04-17 19:48:18.054 +03:00 [INF] ProcessTargetPage was called 46 times
2023-04-17 19:48:18.055 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.056 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.057 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.058 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.142 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.143 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.143 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.145 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.146 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.146 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.147 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.148 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.149 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.150 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.151 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661&start=3950
2023-04-17 19:48:18.153 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=661&start=4000
2023-04-17 19:48:18.157 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.154 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.157 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.158 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.159 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.160 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.161 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.162 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.163 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.164 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.165 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.166 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.167 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.168 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661&start=3950
2023-04-17 19:48:18.169 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=661&start=4000
2023-04-17 19:48:18.173 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6345568
2023-04-17 19:48:18.176 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.177 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.179 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.180 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.182 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6345568
2023-04-17 19:48:18.216 +03:00 [INF] Load finished in 1654 ms
2023-04-17 19:48:18.218 +03:00 [INF] ProcessTargetPage was called 47 times
2023-04-17 19:48:18.221 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.223 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.224 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.225 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.292 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:48:18.294 +03:00 [INF] ProcessTargetPage was called 48 times
2023-04-17 19:48:18.296 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.297 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.299 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.300 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.350 +03:00 [INF] Load finished in 922 ms
2023-04-17 19:48:18.351 +03:00 [INF] ProcessTargetPage was called 49 times
2023-04-17 19:48:18.352 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.353 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.355 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.356 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.388 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.389 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.391 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.392 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.395 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.397 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6290597
2023-04-17 19:48:18.398 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.399 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.400 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.401 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.402 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6290597
2023-04-17 19:48:18.424 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.426 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.427 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.428 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.430 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.432 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6287368
2023-04-17 19:48:18.433 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.434 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.435 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.436 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.440 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6287368
2023-04-17 19:48:18.476 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.478 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.479 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.479 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.481 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.483 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6337247
2023-04-17 19:48:18.484 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.485 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.488 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.489 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.491 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6337247
2023-04-17 19:48:18.499 +03:00 [INF] Load finished in 1435 ms
2023-04-17 19:48:18.503 +03:00 [INF] ProcessTargetPage was called 50 times
2023-04-17 19:48:18.505 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.506 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.507 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.508 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.509 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.510 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.511 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.512 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.514 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.515 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.518 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6225285
2023-04-17 19:48:18.519 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.520 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.521 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.522 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.523 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.524 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.525 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.526 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.528 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.528 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6302884
2023-04-17 19:48:18.529 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6225285
2023-04-17 19:48:18.530 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.532 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.536 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.537 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.538 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.539 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.540 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.541 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.542 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6245792
2023-04-17 19:48:18.543 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6302884
2023-04-17 19:48:18.544 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.548 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.549 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.551 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.552 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6245792
2023-04-17 19:48:18.622 +03:00 [INF] Load finished in 910 ms
2023-04-17 19:48:18.651 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:18.653 +03:00 [INF] Received 50 new jobs
2023-04-17 19:48:18.654 +03:00 [INF] Start RedisScheduler.AddAsync with 50 jobs
2023-04-17 19:48:18.663 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6312982
2023-04-17 19:48:18.664 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.665 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.667 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.668 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.669 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6312982
2023-04-17 19:48:18.713 +03:00 [INF] Load finished in 882 ms
2023-04-17 19:48:18.762 +03:00 [INF] Found 6 with pagination
2023-04-17 19:48:18.764 +03:00 [INF] Received 51 new jobs
2023-04-17 19:48:18.765 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:48:18.773 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6349774
2023-04-17 19:48:18.774 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.775 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.776 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.777 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.779 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6349774
2023-04-17 19:48:18.793 +03:00 [INF] Load finished in 1045 ms
2023-04-17 19:48:18.825 +03:00 [INF] Found 6 with pagination
2023-04-17 19:48:18.827 +03:00 [INF] Received 51 new jobs
2023-04-17 19:48:18.828 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:48:18.842 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:18.843 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:18.844 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6157631
2023-04-17 19:48:18.848 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:18.849 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.849 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:18.850 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.851 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:18.852 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.854 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6334487
2023-04-17 19:48:18.855 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.856 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.857 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6157631
2023-04-17 19:48:18.857 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.862 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.864 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:18.865 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6334487
2023-04-17 19:48:18.918 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:48:18.919 +03:00 [INF] ProcessTargetPage was called 51 times
2023-04-17 19:48:18.921 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:18.922 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:18.923 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:18.925 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.005 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:19.006 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:19.007 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:19.008 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:19.009 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:19.011 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6342167
2023-04-17 19:48:19.012 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.013 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.014 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.015 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.018 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6342167
2023-04-17 19:48:19.029 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:19.030 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:19.033 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:19.035 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:19.036 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:19.037 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:19.037 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6290378
2023-04-17 19:48:19.038 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:19.039 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.040 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:19.041 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.042 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:19.044 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.045 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:19.046 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.049 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6185848
2023-04-17 19:48:19.050 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6290378
2023-04-17 19:48:19.051 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.053 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.054 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.055 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.056 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6185848
2023-04-17 19:48:19.075 +03:00 [INF] Load finished in 900 ms
2023-04-17 19:48:19.086 +03:00 [INF] Load finished in 910 ms
2023-04-17 19:48:19.145 +03:00 [INF] Load finished in 742 ms
2023-04-17 19:48:19.146 +03:00 [INF] ProcessTargetPage was called 52 times
2023-04-17 19:48:19.147 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.148 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.149 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.150 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.151 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:19.161 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:19.163 +03:00 [INF] Received 48 new jobs
2023-04-17 19:48:19.163 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:19.164 +03:00 [INF] Received 37 new jobs
2023-04-17 19:48:19.165 +03:00 [INF] Start RedisScheduler.AddAsync with 48 jobs
2023-04-17 19:48:19.166 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:19.167 +03:00 [INF] Start RedisScheduler.AddAsync with 37 jobs
2023-04-17 19:48:19.172 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:19.177 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:19.178 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:19.179 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6329044
2023-04-17 19:48:19.182 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6241770
2023-04-17 19:48:19.183 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6335506
2023-04-17 19:48:19.183 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.184 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.185 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.189 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.190 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.191 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.192 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.193 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.194 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.195 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.197 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.198 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.199 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6329044
2023-04-17 19:48:19.200 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6241770
2023-04-17 19:48:19.203 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6335506
2023-04-17 19:48:19.229 +03:00 [INF] Load finished in 737 ms
2023-04-17 19:48:19.231 +03:00 [INF] ProcessTargetPage was called 53 times
2023-04-17 19:48:19.232 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.233 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.235 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.236 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.267 +03:00 [INF] Load finished in 722 ms
2023-04-17 19:48:19.269 +03:00 [INF] ProcessTargetPage was called 54 times
2023-04-17 19:48:19.270 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.271 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.272 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:19.273 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.273 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:19.275 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.275 +03:00 [INF] Load finished in 739 ms
2023-04-17 19:48:19.275 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:19.277 +03:00 [INF] ProcessTargetPage was called 55 times
2023-04-17 19:48:19.278 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:19.280 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.281 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:19.282 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.284 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6214370
2023-04-17 19:48:19.285 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.286 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.287 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.288 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.290 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.291 +03:00 [INF] Load finished in 738 ms
2023-04-17 19:48:19.308 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.309 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:19.309 +03:00 [INF] ProcessTargetPage was called 56 times
2023-04-17 19:48:19.312 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6214370
2023-04-17 19:48:19.312 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:19.314 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.317 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:19.318 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.319 +03:00 [INF] Load finished in 877 ms
2023-04-17 19:48:19.319 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:19.321 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.323 +03:00 [INF] ProcessTargetPage was called 57 times
2023-04-17 19:48:19.324 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:19.326 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.327 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.329 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6234570
2023-04-17 19:48:19.330 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.331 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.333 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.334 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.335 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.336 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.342 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.343 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6234570
2023-04-17 19:48:19.404 +03:00 [INF] Load finished in 734 ms
2023-04-17 19:48:19.406 +03:00 [INF] ProcessTargetPage was called 58 times
2023-04-17 19:48:19.408 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.409 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.411 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.412 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.492 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:19.494 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:19.495 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:19.497 +03:00 [INF] Load finished in 717 ms
2023-04-17 19:48:19.497 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:19.498 +03:00 [INF] ProcessTargetPage was called 59 times
2023-04-17 19:48:19.499 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:19.500 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.503 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4821060
2023-04-17 19:48:19.503 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.504 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.505 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.506 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.507 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.508 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.514 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.515 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4821060
2023-04-17 19:48:19.587 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:48:19.590 +03:00 [INF] ProcessTargetPage was called 60 times
2023-04-17 19:48:19.592 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.593 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.594 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.595 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.766 +03:00 [INF] Load finished in 747 ms
2023-04-17 19:48:19.768 +03:00 [INF] ProcessTargetPage was called 61 times
2023-04-17 19:48:19.769 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.770 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.772 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.773 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.926 +03:00 [INF] Load finished in 873 ms
2023-04-17 19:48:19.927 +03:00 [INF] ProcessTargetPage was called 62 times
2023-04-17 19:48:19.928 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.930 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.932 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.934 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.935 +03:00 [INF] Load finished in 1075 ms
2023-04-17 19:48:19.936 +03:00 [INF] ProcessTargetPage was called 63 times
2023-04-17 19:48:19.937 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.938 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.939 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.941 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:19.963 +03:00 [INF] Load finished in 906 ms
2023-04-17 19:48:19.964 +03:00 [INF] ProcessTargetPage was called 64 times
2023-04-17 19:48:19.966 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:19.967 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:19.969 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:19.970 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.041 +03:00 [INF] Load finished in 725 ms
2023-04-17 19:48:20.042 +03:00 [INF] ProcessTargetPage was called 65 times
2023-04-17 19:48:20.043 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.044 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.044 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.046 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.046 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.048 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.049 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.050 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.051 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.053 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5349656
2023-04-17 19:48:20.058 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.059 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.060 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.061 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.062 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5349656
2023-04-17 19:48:20.073 +03:00 [INF] Load finished in 728 ms
2023-04-17 19:48:20.074 +03:00 [INF] ProcessTargetPage was called 66 times
2023-04-17 19:48:20.076 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.077 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.078 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.080 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.083 +03:00 [INF] Load finished in 879 ms
2023-04-17 19:48:20.084 +03:00 [INF] ProcessTargetPage was called 67 times
2023-04-17 19:48:20.090 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.091 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.092 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.094 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.234 +03:00 [INF] Load finished in 717 ms
2023-04-17 19:48:20.235 +03:00 [INF] ProcessTargetPage was called 68 times
2023-04-17 19:48:20.237 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.237 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.238 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.240 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.266 +03:00 [INF] Load finished in 1057 ms
2023-04-17 19:48:20.267 +03:00 [INF] ProcessTargetPage was called 69 times
2023-04-17 19:48:20.269 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.270 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.272 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.276 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.399 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.400 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.402 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.402 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.404 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.406 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6348513
2023-04-17 19:48:20.406 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.407 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.409 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.410 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.411 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6348513
2023-04-17 19:48:20.423 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.423 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.424 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.425 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.426 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.426 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.427 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.428 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.429 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.433 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.435 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351958
2023-04-17 19:48:20.436 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6352051
2023-04-17 19:48:20.437 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.439 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.438 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.440 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.441 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.442 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.443 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.444 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351958
2023-04-17 19:48:20.444 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.447 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.448 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.450 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6352051
2023-04-17 19:48:20.451 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.452 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.453 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.455 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6336728
2023-04-17 19:48:20.455 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.456 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.458 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.459 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.460 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6336728
2023-04-17 19:48:20.462 +03:00 [INF] Load finished in 1254 ms
2023-04-17 19:48:20.466 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.466 +03:00 [INF] ProcessTargetPage was called 70 times
2023-04-17 19:48:20.467 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.469 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.470 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.471 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.472 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.473 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.474 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.476 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.480 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6351589
2023-04-17 19:48:20.480 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.482 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.483 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.485 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.486 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.499 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.501 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.503 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.504 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.505 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6351589
2023-04-17 19:48:20.506 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6349810
2023-04-17 19:48:20.509 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.510 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.511 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.512 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.513 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6349810
2023-04-17 19:48:20.532 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.533 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.534 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.535 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.536 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.538 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5411505
2023-04-17 19:48:20.539 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.540 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.542 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.543 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.544 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5411505
2023-04-17 19:48:20.687 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.688 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.690 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.691 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.693 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.695 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6240987
2023-04-17 19:48:20.696 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.697 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.698 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.700 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.701 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6240987
2023-04-17 19:48:20.734 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.735 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.736 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.737 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.738 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.740 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6008470
2023-04-17 19:48:20.743 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.744 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.746 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.748 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.749 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6008470
2023-04-17 19:48:20.906 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:20.907 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:20.908 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:20.909 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:20.911 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:20.913 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6095465
2023-04-17 19:48:20.913 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.924 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.925 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.926 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:20.927 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6095465
2023-04-17 19:48:20.974 +03:00 [INF] Load finished in 910 ms
2023-04-17 19:48:20.976 +03:00 [INF] ProcessTargetPage was called 71 times
2023-04-17 19:48:20.977 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:20.978 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:20.990 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:20.994 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.059 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.061 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.062 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.063 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.065 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.067 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1213375
2023-04-17 19:48:21.069 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.070 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.072 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.073 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.074 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1213375
2023-04-17 19:48:21.091 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.092 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.093 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.094 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.095 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.096 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5939292
2023-04-17 19:48:21.097 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.099 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.101 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.102 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.103 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5939292
2023-04-17 19:48:21.142 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.143 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.144 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.145 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.149 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.150 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4946302
2023-04-17 19:48:21.151 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.152 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.153 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.154 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.155 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4946302
2023-04-17 19:48:21.163 +03:00 [INF] Load finished in 715 ms
2023-04-17 19:48:21.165 +03:00 [INF] ProcessTargetPage was called 72 times
2023-04-17 19:48:21.166 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.167 +03:00 [INF] Load finished in 715 ms
2023-04-17 19:48:21.167 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.168 +03:00 [INF] ProcessTargetPage was called 73 times
2023-04-17 19:48:21.169 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.170 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.172 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.172 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.175 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.176 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.183 +03:00 [INF] Load finished in 720 ms
2023-04-17 19:48:21.184 +03:00 [INF] ProcessTargetPage was called 74 times
2023-04-17 19:48:21.185 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.187 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.189 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.190 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.192 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.218 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.219 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.220 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.221 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.222 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.223 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.224 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.225 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.227 +03:00 [INF] Load finished in 720 ms
2023-04-17 19:48:21.228 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5209134
2023-04-17 19:48:21.230 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.232 +03:00 [INF] ProcessTargetPage was called 75 times
2023-04-17 19:48:21.233 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.235 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5483349
2023-04-17 19:48:21.236 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.237 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.238 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.239 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.246 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.246 +03:00 [INF] Load finished in 732 ms
2023-04-17 19:48:21.251 +03:00 [INF] ProcessTargetPage was called 76 times
2023-04-17 19:48:21.248 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.249 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.247 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.252 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.254 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.255 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5209134
2023-04-17 19:48:21.255 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.258 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.261 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.287 +03:00 [INF] Load finished in 874 ms
2023-04-17 19:48:21.287 +03:00 [INF] Load finished in 741 ms
2023-04-17 19:48:21.287 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.289 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5483349
2023-04-17 19:48:21.290 +03:00 [INF] ProcessTargetPage was called 77 times
2023-04-17 19:48:21.291 +03:00 [INF] ProcessTargetPage was called 78 times
2023-04-17 19:48:21.302 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.301 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.292 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.308 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.309 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.311 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.312 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.313 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.314 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.383 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.384 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.385 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.386 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.387 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.388 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5057491
2023-04-17 19:48:21.389 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.391 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.392 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.394 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.395 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5057491
2023-04-17 19:48:21.431 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.433 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.434 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.436 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.437 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.439 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3967506
2023-04-17 19:48:21.440 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.441 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.443 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.444 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.445 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3967506
2023-04-17 19:48:21.487 +03:00 [INF] Load finished in 737 ms
2023-04-17 19:48:21.489 +03:00 [INF] ProcessTargetPage was called 79 times
2023-04-17 19:48:21.490 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.493 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.495 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.496 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.573 +03:00 [INF] Load finished in 871 ms
2023-04-17 19:48:21.575 +03:00 [INF] ProcessTargetPage was called 80 times
2023-04-17 19:48:21.576 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.578 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.580 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.581 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.608 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.609 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.611 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.611 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.612 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.614 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6176453
2023-04-17 19:48:21.615 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.618 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.619 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.620 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.621 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6176453
2023-04-17 19:48:21.644 +03:00 [INF] Load finished in 714 ms
2023-04-17 19:48:21.645 +03:00 [INF] ProcessTargetPage was called 81 times
2023-04-17 19:48:21.648 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.649 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.651 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.652 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.773 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:21.774 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:21.775 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:21.776 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:21.777 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:21.779 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6350592
2023-04-17 19:48:21.780 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.781 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.782 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.784 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.785 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6350592
2023-04-17 19:48:21.847 +03:00 [INF] Load finished in 742 ms
2023-04-17 19:48:21.848 +03:00 [INF] ProcessTargetPage was called 82 times
2023-04-17 19:48:21.849 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.850 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.852 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.853 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:21.958 +03:00 [INF] Load finished in 883 ms
2023-04-17 19:48:21.960 +03:00 [INF] ProcessTargetPage was called 83 times
2023-04-17 19:48:21.962 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:21.963 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:21.964 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:21.965 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.033 +03:00 [INF] Load finished in 877 ms
2023-04-17 19:48:22.035 +03:00 [INF] ProcessTargetPage was called 84 times
2023-04-17 19:48:22.036 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.036 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.038 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.039 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.102 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.103 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.104 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.104 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.105 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.107 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5177020
2023-04-17 19:48:22.108 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.108 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.109 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.111 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.112 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5177020
2023-04-17 19:48:22.303 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.304 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.305 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.308 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.309 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.315 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6094182
2023-04-17 19:48:22.315 +03:00 [INF] Load finished in 1055 ms
2023-04-17 19:48:22.315 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.316 +03:00 [INF] ProcessTargetPage was called 85 times
2023-04-17 19:48:22.317 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.318 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.319 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.320 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.322 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.323 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.325 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6094182
2023-04-17 19:48:22.326 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.337 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.338 +03:00 [INF] Load finished in 715 ms
2023-04-17 19:48:22.342 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.345 +03:00 [INF] ProcessTargetPage was called 86 times
2023-04-17 19:48:22.346 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.347 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.348 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.349 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.350 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.351 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.353 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6077573
2023-04-17 19:48:22.355 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.356 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.358 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.359 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.360 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.361 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6077573
2023-04-17 19:48:22.386 +03:00 [INF] Load finished in 1086 ms
2023-04-17 19:48:22.388 +03:00 [INF] ProcessTargetPage was called 87 times
2023-04-17 19:48:22.389 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.390 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.392 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.393 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.425 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.426 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.427 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.428 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.429 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.431 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6095026
2023-04-17 19:48:22.432 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.433 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.435 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.436 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.437 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6095026
2023-04-17 19:48:22.441 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.459 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.461 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.461 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.462 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.463 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.463 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.466 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.466 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.468 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.469 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.471 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.473 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=3446270
2023-04-17 19:48:22.474 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.475 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.476 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.478 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5301491
2023-04-17 19:48:22.479 +03:00 [INF] Load finished in 1083 ms
2023-04-17 19:48:22.480 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.482 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.483 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.485 +03:00 [INF] ProcessTargetPage was called 88 times
2023-04-17 19:48:22.487 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5245641
2023-04-17 19:48:22.488 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.489 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.491 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.492 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.493 +03:00 [INF] Load finished in 1046 ms
2023-04-17 19:48:22.494 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.499 +03:00 [INF] Load finished in 713 ms
2023-04-17 19:48:22.499 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.500 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.501 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.502 +03:00 [INF] ProcessTargetPage was called 89 times
2023-04-17 19:48:22.504 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=3446270
2023-04-17 19:48:22.504 +03:00 [INF] ProcessTargetPage was called 90 times
2023-04-17 19:48:22.506 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.507 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.509 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.510 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.513 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.515 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5301491
2023-04-17 19:48:22.515 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.516 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.517 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.518 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.521 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5245641
2023-04-17 19:48:22.522 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.523 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.537 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.539 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.608 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.609 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.610 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.611 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.612 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.613 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=4911741
2023-04-17 19:48:22.614 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.615 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.617 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.618 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.619 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=4911741
2023-04-17 19:48:22.719 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.720 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.722 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.722 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.723 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.725 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6028295
2023-04-17 19:48:22.726 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.727 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.728 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.729 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.730 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6028295
2023-04-17 19:48:22.809 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.810 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.812 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.813 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.814 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.816 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6090413
2023-04-17 19:48:22.817 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.817 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.828 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.829 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.829 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:48:22.830 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6090413
2023-04-17 19:48:22.831 +03:00 [INF] ProcessTargetPage was called 91 times
2023-04-17 19:48:22.833 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.834 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.835 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.836 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.988 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:22.988 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:22.990 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:22.990 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:22.991 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:22.993 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388&start=50
2023-04-17 19:48:22.993 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:22.994 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:22.995 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:22.996 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:22.998 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388&start=50
2023-04-17 19:48:23.048 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:48:23.049 +03:00 [INF] ProcessTargetPage was called 92 times
2023-04-17 19:48:23.050 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.051 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.053 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.054 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.082 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:48:23.083 +03:00 [INF] ProcessTargetPage was called 93 times
2023-04-17 19:48:23.084 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.085 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.087 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.088 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.107 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.108 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.109 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.109 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.110 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.112 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388&start=100
2023-04-17 19:48:23.112 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.113 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.114 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.115 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.117 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388&start=100
2023-04-17 19:48:23.163 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.164 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.166 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.167 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.168 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.173 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388&start=4000
2023-04-17 19:48:23.174 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.175 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.176 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.178 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.179 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388&start=4000
2023-04-17 19:48:23.226 +03:00 [INF] Load finished in 713 ms
2023-04-17 19:48:23.227 +03:00 [INF] ProcessTargetPage was called 94 times
2023-04-17 19:48:23.228 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.229 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.230 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.231 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.344 +03:00 [INF] Load finished in 906 ms
2023-04-17 19:48:23.346 +03:00 [INF] ProcessTargetPage was called 95 times
2023-04-17 19:48:23.347 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.348 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.349 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.351 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.363 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.364 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.365 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.366 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.367 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.369 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388&start=4050
2023-04-17 19:48:23.370 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.372 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.395 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.396 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.397 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388&start=4050
2023-04-17 19:48:23.435 +03:00 [INF] Load finished in 911 ms
2023-04-17 19:48:23.436 +03:00 [INF] ProcessTargetPage was called 96 times
2023-04-17 19:48:23.437 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.438 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.439 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.441 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.472 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.473 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.474 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.474 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.476 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.478 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewforum.php?f=2388&start=4100
2023-04-17 19:48:23.479 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.480 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.481 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.482 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.484 +03:00 [INF] Loading static page https://rutracker.org/forum/viewforum.php?f=2388&start=4100
2023-04-17 19:48:23.498 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.498 +03:00 [INF] Load finished in 876 ms
2023-04-17 19:48:23.498 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.500 +03:00 [INF] ProcessTargetPage was called 97 times
2023-04-17 19:48:23.504 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.506 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.507 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.509 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.520 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.521 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.523 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5179223
2023-04-17 19:48:23.524 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.524 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.526 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.527 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.528 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.529 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5179223
2023-04-17 19:48:23.546 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.547 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.549 +03:00 [INF] Load finished in 716 ms
2023-04-17 19:48:23.549 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.552 +03:00 [INF] ProcessTargetPage was called 98 times
2023-04-17 19:48:23.553 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.554 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.555 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.556 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.558 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5625105
2023-04-17 19:48:23.560 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.561 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.562 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.563 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.565 +03:00 [INF] Load finished in 1046 ms
2023-04-17 19:48:23.568 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.569 +03:00 [INF] ProcessTargetPage was called 99 times
2023-04-17 19:48:23.570 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.572 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.573 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5625105
2023-04-17 19:48:23.574 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.576 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.578 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.640 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.641 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.662 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.663 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.664 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.665 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.666 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2793076
2023-04-17 19:48:23.667 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.669 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.675 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.678 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.679 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.679 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.680 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.681 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.682 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.683 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.685 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=616451
2023-04-17 19:48:23.686 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.687 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2793076
2023-04-17 19:48:23.687 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.688 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.694 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.696 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.698 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.700 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5734215
2023-04-17 19:48:23.702 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.703 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.704 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=616451
2023-04-17 19:48:23.706 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.713 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.714 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.715 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5734215
2023-04-17 19:48:23.979 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:23.980 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:23.981 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:23.982 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:23.982 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:23.984 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6232906
2023-04-17 19:48:23.985 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:23.986 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:23.987 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:23.988 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:23.991 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6232906
2023-04-17 19:48:24.083 +03:00 [INF] Load finished in 1084 ms
2023-04-17 19:48:24.093 +03:00 [INF] Load finished in 913 ms
2023-04-17 19:48:24.127 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:24.129 +03:00 [INF] Received 47 new jobs
2023-04-17 19:48:24.130 +03:00 [INF] Start RedisScheduler.AddAsync with 47 jobs
2023-04-17 19:48:24.136 +03:00 [INF] Found 6 with pagination
2023-04-17 19:48:24.138 +03:00 [INF] Received 51 new jobs
2023-04-17 19:48:24.139 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:48:24.139 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2723170
2023-04-17 19:48:24.142 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.143 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.144 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.145 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.148 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1242564
2023-04-17 19:48:24.150 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2723170
2023-04-17 19:48:24.151 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.153 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.155 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.156 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.157 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1242564
2023-04-17 19:48:24.165 +03:00 [INF] Load finished in 1047 ms
2023-04-17 19:48:24.188 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:24.189 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:24.190 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:24.190 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:24.192 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:24.195 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1245394
2023-04-17 19:48:24.196 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.206 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.207 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.208 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.209 +03:00 [INF] Found 6 with pagination
2023-04-17 19:48:24.210 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1245394
2023-04-17 19:48:24.211 +03:00 [INF] Load finished in 726 ms
2023-04-17 19:48:24.215 +03:00 [INF] Received 51 new jobs
2023-04-17 19:48:24.217 +03:00 [INF] Start RedisScheduler.AddAsync with 51 jobs
2023-04-17 19:48:24.226 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1371756
2023-04-17 19:48:24.240 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.241 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:24.244 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.248 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:48:24.249 +03:00 [INF] Received 22 new jobs
2023-04-17 19:48:24.249 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.250 +03:00 [INF] ProcessTargetPage was called 100 times
2023-04-17 19:48:24.252 +03:00 [INF] Start RedisScheduler.AddAsync with 22 jobs
2023-04-17 19:48:24.253 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.254 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.256 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1371756
2023-04-17 19:48:24.258 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.259 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1688697
2023-04-17 19:48:24.260 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.261 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.262 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.263 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.264 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.265 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.267 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1688697
2023-04-17 19:48:24.294 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:48:24.295 +03:00 [INF] ProcessTargetPage was called 101 times
2023-04-17 19:48:24.296 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.297 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.298 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.299 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.364 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:24.365 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:24.368 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:24.369 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:24.370 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:24.371 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6210488
2023-04-17 19:48:24.373 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.374 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.375 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.376 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.377 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6210488
2023-04-17 19:48:24.441 +03:00 [INF] Load finished in 730 ms
2023-04-17 19:48:24.443 +03:00 [INF] ProcessTargetPage was called 102 times
2023-04-17 19:48:24.444 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.445 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.446 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.447 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.451 +03:00 [INF] Load finished in 734 ms
2023-04-17 19:48:24.452 +03:00 [INF] ProcessTargetPage was called 103 times
2023-04-17 19:48:24.453 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.454 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.455 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.456 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.457 +03:00 [INF] Load finished in 1059 ms
2023-04-17 19:48:24.468 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:24.468 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:24.469 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:24.470 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:24.477 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:24.479 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=2337029
2023-04-17 19:48:24.480 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.481 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.482 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.483 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.484 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=2337029
2023-04-17 19:48:24.489 +03:00 [INF] Found 5 with pagination
2023-04-17 19:48:24.494 +03:00 [INF] Received 49 new jobs
2023-04-17 19:48:24.495 +03:00 [INF] Start RedisScheduler.AddAsync with 49 jobs
2023-04-17 19:48:24.509 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5949104
2023-04-17 19:48:24.510 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.511 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.512 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.513 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.514 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5949104
2023-04-17 19:48:24.568 +03:00 [INF] Load finished in 876 ms
2023-04-17 19:48:24.569 +03:00 [INF] ProcessTargetPage was called 104 times
2023-04-17 19:48:24.569 +03:00 [INF] Load finished in 1835 ms
2023-04-17 19:48:24.570 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.571 +03:00 [INF] ProcessTargetPage was called 105 times
2023-04-17 19:48:24.572 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.573 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.575 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.575 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.576 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.577 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.579 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.666 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:24.667 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:24.668 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:24.669 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:24.671 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:24.672 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:24.673 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=1964480
2023-04-17 19:48:24.674 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:24.675 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.684 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:24.686 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.689 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:24.690 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.691 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:24.695 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.696 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=5798565
2023-04-17 19:48:24.697 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=1964480
2023-04-17 19:48:24.698 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.700 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.701 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:24.702 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.702 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:24.705 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.706 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:24.707 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=5798565
2023-04-17 19:48:24.710 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:24.712 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:24.713 +03:00 [INF] Load finished in 719 ms
2023-04-17 19:48:24.714 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:24.714 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6268083
2023-04-17 19:48:24.715 +03:00 [INF] ProcessTargetPage was called 106 times
2023-04-17 19:48:24.716 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:24.717 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.718 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.719 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:24.719 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.720 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.721 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:24.722 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.728 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.729 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:24.730 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.731 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.733 +03:00 [INF] Start crawling url https://rutracker.org/forum/viewtopic.php?t=6324573
2023-04-17 19:48:24.735 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6268083
2023-04-17 19:48:24.742 +03:00 [INF] Application is shutting down...
2023-04-17 19:48:24.742 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.745 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.746 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.747 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.748 +03:00 [INF] Loading static page https://rutracker.org/forum/viewtopic.php?t=6324573
2023-04-17 19:48:24.894 +03:00 [INF] Load finished in 735 ms
2023-04-17 19:48:24.895 +03:00 [INF] ProcessTargetPage was called 107 times
2023-04-17 19:48:24.896 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.897 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.898 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.899 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:24.983 +03:00 [INF] Load finished in 715 ms
2023-04-17 19:48:24.984 +03:00 [INF] ProcessTargetPage was called 108 times
2023-04-17 19:48:24.985 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:24.986 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:24.987 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:24.988 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.091 +03:00 [INF] Load finished in 713 ms
2023-04-17 19:48:25.093 +03:00 [INF] ProcessTargetPage was called 109 times
2023-04-17 19:48:25.094 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.095 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.096 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.098 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.121 +03:00 [INF] Load finished in 906 ms
2023-04-17 19:48:25.122 +03:00 [INF] ProcessTargetPage was called 110 times
2023-04-17 19:48:25.124 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.125 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.127 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.129 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.139 +03:00 [INF] Load finished in 880 ms
2023-04-17 19:48:25.140 +03:00 [INF] ProcessTargetPage was called 111 times
2023-04-17 19:48:25.142 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.147 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.149 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.151 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.232 +03:00 [INF] Load finished in 1079 ms
2023-04-17 19:48:25.233 +03:00 [INF] ProcessTargetPage was called 112 times
2023-04-17 19:48:25.235 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.236 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.240 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.241 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.247 +03:00 [INF] Load finished in 732 ms
2023-04-17 19:48:25.249 +03:00 [INF] ProcessTargetPage was called 113 times
2023-04-17 19:48:25.251 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.252 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.255 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.256 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.287 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:25.288 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:25.289 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:25.289 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:25.291 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:25.394 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:25.397 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:25.398 +03:00 [INF] Load finished in 913 ms
2023-04-17 19:48:25.399 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:25.399 +03:00 [INF] ProcessTargetPage was called 114 times
2023-04-17 19:48:25.400 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:25.401 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.402 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:25.403 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.406 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.407 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.432 +03:00 [INF] Load finished in 721 ms
2023-04-17 19:48:25.433 +03:00 [INF] ProcessTargetPage was called 115 times
2023-04-17 19:48:25.434 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.435 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.436 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.437 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.444 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:25.445 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:25.446 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:25.447 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:25.448 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:25.457 +03:00 [INF] Load finished in 713 ms
2023-04-17 19:48:25.461 +03:00 [INF] ProcessTargetPage was called 116 times
2023-04-17 19:48:25.462 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.463 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.464 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.465 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.468 +03:00 [INF] Load finished in 718 ms
2023-04-17 19:48:25.469 +03:00 [INF] ProcessTargetPage was called 117 times
2023-04-17 19:48:25.470 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.471 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.472 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.475 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.566 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:25.567 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:25.568 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:25.569 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:25.570 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:25.715 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:25.716 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:25.717 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:25.717 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:25.719 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:25.726 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:25.727 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:25.728 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:25.729 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:25.730 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:25.757 +03:00 [INF] Load finished in 1057 ms
2023-04-17 19:48:25.758 +03:00 [INF] ProcessTargetPage was called 118 times
2023-04-17 19:48:25.759 +03:00 [INF] Start GetConfigAsync
2023-04-17 19:48:25.760 +03:00 [INF] Checking if rutracker-scraper-config exists in Redis
2023-04-17 19:48:25.761 +03:00 [INF] Getting scraper config by key rutracker-scraper-config from Redis
2023-04-17 19:48:25.762 +03:00 [INF] Deserializing json string to scraper config
2023-04-17 19:48:25.882 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:25.883 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:25.884 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:25.884 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:25.885 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.003 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.004 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.005 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.006 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.007 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.119 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.120 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.121 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.122 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.131 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.245 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.246 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.247 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.247 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.248 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.271 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.271 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.271 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.272 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.273 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.274 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.274 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.275 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.276 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.277 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.366 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.367 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.368 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.368 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.369 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.379 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.380 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.381 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.382 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.383 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.530 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.531 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.532 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.533 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.534 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.561 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.562 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.564 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.564 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.565 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.572 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.573 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.574 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.575 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.576 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.612 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.613 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.614 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.614 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.615 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.619 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.620 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.621 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.622 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.623 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
2023-04-17 19:48:26.905 +03:00 [INF] Sending scraped data to sinks...
2023-04-17 19:48:26.906 +03:00 [INF] Waiting for sinks ...
2023-04-17 19:48:26.907 +03:00 [INF] Finished waiting for sinks
2023-04-17 19:48:26.908 +03:00 [INF] Received 0 new jobs
2023-04-17 19:48:26.909 +03:00 [INF] Start RedisScheduler.AddAsync with 0 jobs
