Incidents | Luigi's Box Incidents reported on status page for Luigi's Box https://www.luigisboxstatus.com/ https://d1lppblt9t2x15.cloudfront.net/logos/fefa5dbf53865f68f5970b77d66260fd.png Incidents | Luigi's Box https://www.luigisboxstatus.com/ en Increased timeout rate https://www.luigisboxstatus.com/incident/542708 Wed, 09 Apr 2025 19:47:00 -0000 https://www.luigisboxstatus.com/incident/542708#40a3895cca0c4277956f0bc3900dede4009824e04ee50106ce1abfedfe181939 All configuration discrepancies have been fixed and stability of recommender service restored. We are monitoring the situation. Increased timeout rate https://www.luigisboxstatus.com/incident/542708 Wed, 09 Apr 2025 19:04:00 -0000 https://www.luigisboxstatus.com/incident/542708#1214ef688cbb07ff4d46f1fc8c9ed9e7eb91b777556bdd6f2337d995036e310f We have identified the root cause of the timeouts as an independent configuration change relating to real-time storage subsystem. Increased timeout rate https://www.luigisboxstatus.com/incident/542708 Wed, 09 Apr 2025 14:09:00 -0000 https://www.luigisboxstatus.com/incident/542708#4de9f7f3158ff1ba80579f4bb3ed0d05601fbc2e40cbe9ae65587a64ffec3720 We are investigating reports of increased failure and timeout rate from our recommender service. Increased error rate of content updates / indexing https://www.luigisboxstatus.com/incident/517133 Sat, 22 Feb 2025 02:22:00 -0000 https://www.luigisboxstatus.com/incident/517133#ae175263248ea9a0978fbabb526cea8b7eab5f955c4794cdfcd2c9a013fa4fa5 We have identified the root cause as a failure in scheduling and scaling mechanism. The problem has been fixed and stability of the service restored. We are monitoring the situation. Increased error rate of content updates / indexing https://www.luigisboxstatus.com/incident/517133 Sat, 22 Feb 2025 02:09:00 -0000 https://www.luigisboxstatus.com/incident/517133#cbe0fdbb713d1aa421aa74363b2f93e10d03981538b96894b3c660bed72f4cf0 Content updates / indexing service is unavailable and incoming requests are being dropped. Increased error rate of content updates / indexing https://www.luigisboxstatus.com/incident/517133 Sat, 22 Feb 2025 02:03:00 -0000 https://www.luigisboxstatus.com/incident/517133#48b3537085194791ad6f1c261e043c4ed2a6be7df0069fa0bdfc3f74d5702e6d We are investigating higher error rate in content updates / indexing service. Increased latencies and timeout rate https://www.luigisboxstatus.com/incident/516612 Fri, 21 Feb 2025 07:05:00 -0000 https://www.luigisboxstatus.com/incident/516612#8f8161857751b323d1320a5d2d86441c25f7e6a86f23814c88d757d00f806667 We have identified the root cause as configuration change that manifested itself only as the morning traffic started to build up causing issues with autoscaling to keep up. We have fixed the configuration and latencies and timeout rate are back to normal. Increased latencies and timeout rate https://www.luigisboxstatus.com/incident/516612 Fri, 21 Feb 2025 07:05:00 -0000 https://www.luigisboxstatus.com/incident/516612#8f8161857751b323d1320a5d2d86441c25f7e6a86f23814c88d757d00f806667 We have identified the root cause as configuration change that manifested itself only as the morning traffic started to build up causing issues with autoscaling to keep up. We have fixed the configuration and latencies and timeout rate are back to normal. Increased latencies and timeout rate https://www.luigisboxstatus.com/incident/516612 Fri, 21 Feb 2025 05:52:00 -0000 https://www.luigisboxstatus.com/incident/516612#fcb98d6670e40fca6cb09b79ee00f2b1e7b4a55e26a1fc895f5f0026a06f4e33 We are investigating higher latencies and elevated timeout rate impacting search and autocomplete. Increased latencies and timeout rate https://www.luigisboxstatus.com/incident/516612 Fri, 21 Feb 2025 05:52:00 -0000 https://www.luigisboxstatus.com/incident/516612#fcb98d6670e40fca6cb09b79ee00f2b1e7b4a55e26a1fc895f5f0026a06f4e33 We are investigating higher latencies and elevated timeout rate impacting search and autocomplete. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 21:19:00 -0000 https://www.luigisboxstatus.com/incident/503397#44870fea0f02f1cd5666582d14eb9ca8263bce8215c5cf81b765301760a8aca7 All services are fully available with additional measures taken to increase capacity and reliability. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 21:19:00 -0000 https://www.luigisboxstatus.com/incident/503397#44870fea0f02f1cd5666582d14eb9ca8263bce8215c5cf81b765301760a8aca7 All services are fully available with additional measures taken to increase capacity and reliability. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 21:19:00 -0000 https://www.luigisboxstatus.com/incident/503397#44870fea0f02f1cd5666582d14eb9ca8263bce8215c5cf81b765301760a8aca7 All services are fully available with additional measures taken to increase capacity and reliability. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 21:05:00 -0000 https://www.luigisboxstatus.com/incident/503397#743d8c811e0b8bd3ff1ae5f95dc60b73a357651da2b060c8d317a05dda6440da Error rate is back to normal and we are monitoring the situation closely before declaring the incident over. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 21:05:00 -0000 https://www.luigisboxstatus.com/incident/503397#743d8c811e0b8bd3ff1ae5f95dc60b73a357651da2b060c8d317a05dda6440da Error rate is back to normal and we are monitoring the situation closely before declaring the incident over. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 21:05:00 -0000 https://www.luigisboxstatus.com/incident/503397#743d8c811e0b8bd3ff1ae5f95dc60b73a357651da2b060c8d317a05dda6440da Error rate is back to normal and we are monitoring the situation closely before declaring the incident over. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 20:43:00 -0000 https://www.luigisboxstatus.com/incident/503397#7a3b7c898b972377d633412f7d1a1b19e81559b0de012ecefeb09b9436c3cec4 We are investigating elevated error rate impacting search, autocomplete and recommendations. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 20:43:00 -0000 https://www.luigisboxstatus.com/incident/503397#7a3b7c898b972377d633412f7d1a1b19e81559b0de012ecefeb09b9436c3cec4 We are investigating elevated error rate impacting search, autocomplete and recommendations. Increased latencies and error rate https://www.luigisboxstatus.com/incident/503397 Tue, 28 Jan 2025 20:43:00 -0000 https://www.luigisboxstatus.com/incident/503397#7a3b7c898b972377d633412f7d1a1b19e81559b0de012ecefeb09b9436c3cec4 We are investigating elevated error rate impacting search, autocomplete and recommendations. Increased analytics latencies and error rate https://www.luigisboxstatus.com/incident/500679 Fri, 24 Jan 2025 00:00:00 -0000 https://www.luigisboxstatus.com/incident/500679#c793e350db4dc1c256466441e79218febb6baa9df75a663eceee534dd981393c Analytics have fully recovered, error rate and latencies of analytics services are at the nominal level. Increased analytics latencies and error rate https://www.luigisboxstatus.com/incident/500679 Thu, 23 Jan 2025 14:15:00 -0000 https://www.luigisboxstatus.com/incident/500679#37cab09b61ab9fa1999b669bb169b2108ab3e413808446e4b408352e43a24579 We are investigating an incident with our analytics services causing increased latencies and error rate. The restoration process is on-going. Increased error rate https://www.luigisboxstatus.com/incident/461435 Thu, 14 Nov 2024 13:07:00 -0000 https://www.luigisboxstatus.com/incident/461435#f673ca9bfc68d761b93455205812e347aea7fc332953d63bc88d9a1d7e063e50 We implemented additional measures and are now resolving the incident. Increased error rate https://www.luigisboxstatus.com/incident/461435 Thu, 14 Nov 2024 12:33:00 -0000 https://www.luigisboxstatus.com/incident/461435#d7a7a93a083463507335bee6938ee45dd083be335767db07635d4428625e31d8 Error rate is back to normal, but we are monitoring the situation and taking more measure before we declare the incident over. Increased error rate https://www.luigisboxstatus.com/incident/461435 Thu, 14 Nov 2024 12:18:00 -0000 https://www.luigisboxstatus.com/incident/461435#41794e65e10da2a4a071d77548503e239a5bb55de6413b58a6de116a37d3dd31 We are investigating elevated error rate impacting search and autocomplete. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 12:29:00 -0000 https://www.luigisboxstatus.com/incident/459002#ca1834ab57a6b8d38e0c8acddee46ea57e3985470c53be007276a1a3c1f8377e All services are now fully available. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 12:29:00 -0000 https://www.luigisboxstatus.com/incident/459002#ca1834ab57a6b8d38e0c8acddee46ea57e3985470c53be007276a1a3c1f8377e All services are now fully available. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 12:29:00 -0000 https://www.luigisboxstatus.com/incident/459002#ca1834ab57a6b8d38e0c8acddee46ea57e3985470c53be007276a1a3c1f8377e All services are now fully available. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 12:29:00 -0000 https://www.luigisboxstatus.com/incident/459002#ca1834ab57a6b8d38e0c8acddee46ea57e3985470c53be007276a1a3c1f8377e All services are now fully available. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 11:34:00 -0000 https://www.luigisboxstatus.com/incident/459002#99a082d3bab64503f7bddcd4e85c00b930efd47273e635a6b3296fd0e3e66452 We have identified the issue with our storage subsystem and are actively mitigating the issue. Error rates for recommender and content updates API are back to normal already. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 11:34:00 -0000 https://www.luigisboxstatus.com/incident/459002#99a082d3bab64503f7bddcd4e85c00b930efd47273e635a6b3296fd0e3e66452 We have identified the issue with our storage subsystem and are actively mitigating the issue. Error rates for recommender and content updates API are back to normal already. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 11:34:00 -0000 https://www.luigisboxstatus.com/incident/459002#99a082d3bab64503f7bddcd4e85c00b930efd47273e635a6b3296fd0e3e66452 We have identified the issue with our storage subsystem and are actively mitigating the issue. Error rates for recommender and content updates API are back to normal already. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 11:34:00 -0000 https://www.luigisboxstatus.com/incident/459002#99a082d3bab64503f7bddcd4e85c00b930efd47273e635a6b3296fd0e3e66452 We have identified the issue with our storage subsystem and are actively mitigating the issue. Error rates for recommender and content updates API are back to normal already. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 10:50:00 -0000 https://www.luigisboxstatus.com/incident/459002#fe7482ee2d0b2074e5fa636e73ec94c124502bfd01b1500162563693700839ab We are investigating increased latencies and error rates. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 10:50:00 -0000 https://www.luigisboxstatus.com/incident/459002#fe7482ee2d0b2074e5fa636e73ec94c124502bfd01b1500162563693700839ab We are investigating increased latencies and error rates. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 10:50:00 -0000 https://www.luigisboxstatus.com/incident/459002#fe7482ee2d0b2074e5fa636e73ec94c124502bfd01b1500162563693700839ab We are investigating increased latencies and error rates. Increased latencies and error rate https://www.luigisboxstatus.com/incident/459002 Sun, 10 Nov 2024 10:50:00 -0000 https://www.luigisboxstatus.com/incident/459002#fe7482ee2d0b2074e5fa636e73ec94c124502bfd01b1500162563693700839ab We are investigating increased latencies and error rates. Increased analytics and error rate https://www.luigisboxstatus.com/incident/440632 Tue, 08 Oct 2024 01:38:00 -0000 https://www.luigisboxstatus.com/incident/440632#5c5b119c18e3488903456eaca3f472066c1676a45797e47f94b80a16bdd59451 Analytics have fully recovered, error rate and latencies of analytics services are at the nominal level. We are now processing the backlog of accumulated data and monitoring the situation. Increased analytics and error rate https://www.luigisboxstatus.com/incident/440632 Mon, 07 Oct 2024 13:08:00 -0000 https://www.luigisboxstatus.com/incident/440632#9e9063648ea1a48b8fba28fced5e565773388579634036109c05d82366b29bcb We are investigating an incident with our analytics services causing increased latencies and error rate. The restoration process is on-going. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:35:00 -0000 https://www.luigisboxstatus.com/incident/419403#2c10b1408bcb0c5cff3a35021a260ef2e4f4b6e3b46fd4a216e20964d8e67eed Error rates are now back to ~0% for all services. We are conducting internal investigation for the root cause of the incident. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:35:00 -0000 https://www.luigisboxstatus.com/incident/419403#2c10b1408bcb0c5cff3a35021a260ef2e4f4b6e3b46fd4a216e20964d8e67eed Error rates are now back to ~0% for all services. We are conducting internal investigation for the root cause of the incident. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:35:00 -0000 https://www.luigisboxstatus.com/incident/419403#2c10b1408bcb0c5cff3a35021a260ef2e4f4b6e3b46fd4a216e20964d8e67eed Error rates are now back to ~0% for all services. We are conducting internal investigation for the root cause of the incident. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:35:00 -0000 https://www.luigisboxstatus.com/incident/419403#2c10b1408bcb0c5cff3a35021a260ef2e4f4b6e3b46fd4a216e20964d8e67eed Error rates are now back to ~0% for all services. We are conducting internal investigation for the root cause of the incident. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:35:00 -0000 https://www.luigisboxstatus.com/incident/419403#2c10b1408bcb0c5cff3a35021a260ef2e4f4b6e3b46fd4a216e20964d8e67eed Error rates are now back to ~0% for all services. We are conducting internal investigation for the root cause of the incident. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:35:00 -0000 https://www.luigisboxstatus.com/incident/419403#2c10b1408bcb0c5cff3a35021a260ef2e4f4b6e3b46fd4a216e20964d8e67eed Error rates are now back to ~0% for all services. We are conducting internal investigation for the root cause of the incident. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#b2c0ee45dbab19d51fa5e3950085e20dfbd373781f6f6098ada9042e67dbbb51 Recommender error rate is at ~0% and we are declaring the service stable. Search and autocomplete are still affected (error rate at 2-5%). Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#b2c0ee45dbab19d51fa5e3950085e20dfbd373781f6f6098ada9042e67dbbb51 Recommender error rate is at ~0% and we are declaring the service stable. Search and autocomplete are still affected (error rate at 2-5%). Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#b2c0ee45dbab19d51fa5e3950085e20dfbd373781f6f6098ada9042e67dbbb51 Recommender error rate is at ~0% and we are declaring the service stable. Search and autocomplete are still affected (error rate at 2-5%). Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#b2c0ee45dbab19d51fa5e3950085e20dfbd373781f6f6098ada9042e67dbbb51 Recommender error rate is at ~0% and we are declaring the service stable. Search and autocomplete are still affected (error rate at 2-5%). Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#b2c0ee45dbab19d51fa5e3950085e20dfbd373781f6f6098ada9042e67dbbb51 Recommender error rate is at ~0% and we are declaring the service stable. Search and autocomplete are still affected (error rate at 2-5%). Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:08:00 -0000 https://www.luigisboxstatus.com/incident/419403#87f9a45b809c42692f57c236b63726bc562a58d36097f21b4fde5a5fbf296b32 We are replacing the faulty search instances with fresh instances and the error rates are getting back to nominal values. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:08:00 -0000 https://www.luigisboxstatus.com/incident/419403#87f9a45b809c42692f57c236b63726bc562a58d36097f21b4fde5a5fbf296b32 We are replacing the faulty search instances with fresh instances and the error rates are getting back to nominal values. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:08:00 -0000 https://www.luigisboxstatus.com/incident/419403#87f9a45b809c42692f57c236b63726bc562a58d36097f21b4fde5a5fbf296b32 We are replacing the faulty search instances with fresh instances and the error rates are getting back to nominal values. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:08:00 -0000 https://www.luigisboxstatus.com/incident/419403#87f9a45b809c42692f57c236b63726bc562a58d36097f21b4fde5a5fbf296b32 We are replacing the faulty search instances with fresh instances and the error rates are getting back to nominal values. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:08:00 -0000 https://www.luigisboxstatus.com/incident/419403#87f9a45b809c42692f57c236b63726bc562a58d36097f21b4fde5a5fbf296b32 We are replacing the faulty search instances with fresh instances and the error rates are getting back to nominal values. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 15:08:00 -0000 https://www.luigisboxstatus.com/incident/419403#87f9a45b809c42692f57c236b63726bc562a58d36097f21b4fde5a5fbf296b32 We are replacing the faulty search instances with fresh instances and the error rates are getting back to nominal values. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 14:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#30306efe748f8cac16789ce55b64acbb428b27a19f14c4a1aa7cd4bae529839c We are currently facing an issue with our catalog storage system. This has led to the unavailability of our services including autocomplete, search and recommender. Additionally, there has been a noticeable increase in error rates. Our team is actively investigating the issue and working towards a resolution. Further updates will be provided as they become available. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 14:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#30306efe748f8cac16789ce55b64acbb428b27a19f14c4a1aa7cd4bae529839c We are currently facing an issue with our catalog storage system. This has led to the unavailability of our services including autocomplete, search and recommender. Additionally, there has been a noticeable increase in error rates. Our team is actively investigating the issue and working towards a resolution. Further updates will be provided as they become available. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 14:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#30306efe748f8cac16789ce55b64acbb428b27a19f14c4a1aa7cd4bae529839c We are currently facing an issue with our catalog storage system. This has led to the unavailability of our services including autocomplete, search and recommender. Additionally, there has been a noticeable increase in error rates. Our team is actively investigating the issue and working towards a resolution. Further updates will be provided as they become available. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 14:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#30306efe748f8cac16789ce55b64acbb428b27a19f14c4a1aa7cd4bae529839c We are currently facing an issue with our catalog storage system. This has led to the unavailability of our services including autocomplete, search and recommender. Additionally, there has been a noticeable increase in error rates. Our team is actively investigating the issue and working towards a resolution. Further updates will be provided as they become available. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 14:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#30306efe748f8cac16789ce55b64acbb428b27a19f14c4a1aa7cd4bae529839c We are currently facing an issue with our catalog storage system. This has led to the unavailability of our services including autocomplete, search and recommender. Additionally, there has been a noticeable increase in error rates. Our team is actively investigating the issue and working towards a resolution. Further updates will be provided as they become available. Increasing error rates https://www.luigisboxstatus.com/incident/419403 Mon, 26 Aug 2024 14:23:00 -0000 https://www.luigisboxstatus.com/incident/419403#30306efe748f8cac16789ce55b64acbb428b27a19f14c4a1aa7cd4bae529839c We are currently facing an issue with our catalog storage system. This has led to the unavailability of our services including autocomplete, search and recommender. Additionally, there has been a noticeable increase in error rates. Our team is actively investigating the issue and working towards a resolution. Further updates will be provided as they become available. Increased analytics latency and error rate https://www.luigisboxstatus.com/incident/391857 Mon, 01 Jul 2024 21:40:00 -0000 https://www.luigisboxstatus.com/incident/391857#d01bb6c003fcf5517b7de1bb901ba1110952b28df46252fc53f96f8e41967f67 Analytics have fully recovered. We are now processing the backlog of accumulated data. Increased analytics latency and error rate https://www.luigisboxstatus.com/incident/391857 Mon, 01 Jul 2024 15:50:00 -0000 https://www.luigisboxstatus.com/incident/391857#7ca5bdba0fa4c2dba03a1ff8eeee7bc07b9a3c5d67d359235f92a864f30ccaed We have identified the root cause of the issue. The restoration process is on-going, but slow, during which some clients might still see hightened error rates or latencies. After the process ends we will start processing analytics data backlog. Increased indexing error rate https://www.luigisboxstatus.com/incident/391913 Mon, 01 Jul 2024 11:25:00 -0000 https://www.luigisboxstatus.com/incident/391913#15ad958d94c6a5b997d58b648cd220370d2dbe65519f24d268f8113de4c00e4a We have identified the root caused and mitigated the problem. Error rates should be back to normal. Increased indexing error rate https://www.luigisboxstatus.com/incident/391913 Mon, 01 Jul 2024 11:25:00 -0000 https://www.luigisboxstatus.com/incident/391913#15ad958d94c6a5b997d58b648cd220370d2dbe65519f24d268f8113de4c00e4a We have identified the root caused and mitigated the problem. Error rates should be back to normal. Increased indexing error rate https://www.luigisboxstatus.com/incident/391913 Mon, 01 Jul 2024 11:16:00 -0000 https://www.luigisboxstatus.com/incident/391913#dd2466c2822abeb4dcde95951db06663e77b0c24273e687f8b5f8e6d53c738e4 We are investigating increased error rate indexing content by a small subset of clients. Increased indexing error rate https://www.luigisboxstatus.com/incident/391913 Mon, 01 Jul 2024 11:16:00 -0000 https://www.luigisboxstatus.com/incident/391913#dd2466c2822abeb4dcde95951db06663e77b0c24273e687f8b5f8e6d53c738e4 We are investigating increased error rate indexing content by a small subset of clients. Increased analytics latency and error rate https://www.luigisboxstatus.com/incident/391857 Mon, 01 Jul 2024 08:52:00 -0000 https://www.luigisboxstatus.com/incident/391857#25faa6f2fcfd9c0aae2a100d431ebcecfbbfbf0895aac1f6ceaafeebb49671f3 We are investigating increased latencies and error rate within our analytics servcies. Increased latency and error rate https://www.luigisboxstatus.com/incident/385413 Mon, 17 Jun 2024 09:31:00 -0000 https://www.luigisboxstatus.com/incident/385413#90ab286dafa58331fd311bb183c10f5e62a83b9e67862d62671af6f34b4bb094 Incident has been mitigated, but we are still actively looking for root cause so we may prevent it from happening again. Increased latency and error rate https://www.luigisboxstatus.com/incident/385413 Mon, 17 Jun 2024 09:31:00 -0000 https://www.luigisboxstatus.com/incident/385413#90ab286dafa58331fd311bb183c10f5e62a83b9e67862d62671af6f34b4bb094 Incident has been mitigated, but we are still actively looking for root cause so we may prevent it from happening again. Increased latency and error rate https://www.luigisboxstatus.com/incident/385413 Mon, 17 Jun 2024 09:05:00 -0000 https://www.luigisboxstatus.com/incident/385413#e1ba32a21783ef2707926b9edf457cefdab933b911b03c7f0bfd69ba7d908540 We are investigating reports of increased latencies and error rate within our search and recommender services. Increased latency and error rate https://www.luigisboxstatus.com/incident/385413 Mon, 17 Jun 2024 09:05:00 -0000 https://www.luigisboxstatus.com/incident/385413#e1ba32a21783ef2707926b9edf457cefdab933b911b03c7f0bfd69ba7d908540 We are investigating reports of increased latencies and error rate within our search and recommender services. Increased latency and error rate https://www.luigisboxstatus.com/incident/382605 Mon, 10 Jun 2024 14:03:00 -0000 https://www.luigisboxstatus.com/incident/382605#8a9699bfad0426afacae8db81ee06faafc8b787b21d88c819b75926fbbe5c388 Hightened latencies and error rates affected roughly half of our clients using search services that are being migrated to new underlying storage. We took measures to stabilize the service and are still investigating the root cause of the instability. Increased latency and error rate https://www.luigisboxstatus.com/incident/382605 Mon, 10 Jun 2024 13:46:00 -0000 https://www.luigisboxstatus.com/incident/382605#81977814a3ea818fd8960bab50dc9a8364bea657d3e671255d2cd943cd0b2736 We are investigating source of increased latency and elevated error rates for subset of clients. Elevated latencies and error rates https://www.luigisboxstatus.com/incident/350938 Thu, 04 Apr 2024 18:01:00 -0000 https://www.luigisboxstatus.com/incident/350938#2bc433fbae516bdc782bd1bb00c3e77a6e64ab07d4d2e5ff0c22967c5bf8ef5f We took measures to stabilize the service and are still investigating the root cause of the instability. Elevated latencies and error rates https://www.luigisboxstatus.com/incident/350938 Thu, 04 Apr 2024 18:01:00 -0000 https://www.luigisboxstatus.com/incident/350938#2bc433fbae516bdc782bd1bb00c3e77a6e64ab07d4d2e5ff0c22967c5bf8ef5f We took measures to stabilize the service and are still investigating the root cause of the instability. Elevated latencies and error rates https://www.luigisboxstatus.com/incident/350938 Thu, 04 Apr 2024 17:55:00 -0000 https://www.luigisboxstatus.com/incident/350938#4f7938b311dbfc027f08760463c8abe5ef5dcc8719cdee4072b33814b839937e We are investigating increased latencies and error rates. Elevated latencies and error rates https://www.luigisboxstatus.com/incident/350938 Thu, 04 Apr 2024 17:55:00 -0000 https://www.luigisboxstatus.com/incident/350938#4f7938b311dbfc027f08760463c8abe5ef5dcc8719cdee4072b33814b839937e We are investigating increased latencies and error rates. Search service outage impacting clients utilizing frontend libraries https://www.luigisboxstatus.com/incident/323466 Wed, 07 Feb 2024 09:05:00 -0000 https://www.luigisboxstatus.com/incident/323466#db88bce2c6eb22f13b6b576b810e99919819b83da276fc04a1d0d689ef2f897f The problem stemmed from a bug within the search.js library and exlusively impacted clients utilizing search.js library for frontend integration. For the duration of the incident, the search service was not available. Clients integrated on the backend using API, or clients integrated on the frontend but not using search.js were not affected. We've successfully pinpointed the root cause and implemented preventive measures to avert such incidents in the future. Search service outage impacting clients utilizing frontend libraries https://www.luigisboxstatus.com/incident/323466 Wed, 07 Feb 2024 08:54:00 -0000 https://www.luigisboxstatus.com/incident/323466#d50036579041a3e23405e966f27e00600b922f9a1a937307ab11eb6a0e1c5281 The search service is now fully available. Search service outage impacting clients utilizing frontend libraries https://www.luigisboxstatus.com/incident/323466 Wed, 07 Feb 2024 08:51:00 -0000 https://www.luigisboxstatus.com/incident/323466#9b6a315952eb916b909f3d2246f6498149de72bf18de41dbe2f8c1c57ed7dee9 The root cause of the issue has been identified, and efforts are underway to restore services. Search service outage impacting clients utilizing frontend libraries https://www.luigisboxstatus.com/incident/323466 Wed, 07 Feb 2024 08:42:00 -0000 https://www.luigisboxstatus.com/incident/323466#2e80572145dd58f7821be1b9286ebfa50daf098312b3b24718843cab4ed953a5 We are actively investigating the current downtime affecting our search service. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:39:00 -0000 https://www.luigisboxstatus.com/incident/302463#d473eab4732f6dbbaa4e97686c0596ff3b157321a69896a0b7a411637bcbc833 Latencies and error rates are back to nominal values. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:39:00 -0000 https://www.luigisboxstatus.com/incident/302463#d473eab4732f6dbbaa4e97686c0596ff3b157321a69896a0b7a411637bcbc833 Latencies and error rates are back to nominal values. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:39:00 -0000 https://www.luigisboxstatus.com/incident/302463#d473eab4732f6dbbaa4e97686c0596ff3b157321a69896a0b7a411637bcbc833 Latencies and error rates are back to nominal values. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:39:00 -0000 https://www.luigisboxstatus.com/incident/302463#d473eab4732f6dbbaa4e97686c0596ff3b157321a69896a0b7a411637bcbc833 Latencies and error rates are back to nominal values. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:32:00 -0000 https://www.luigisboxstatus.com/incident/302463#25c3eeb8941881be10829f5a78e91bf0e7d6f0a5202f1e3dcbcd617af7a13eee The problem has been mitigated, however some clients may still experience occasional timeouts and hightened error rates. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:32:00 -0000 https://www.luigisboxstatus.com/incident/302463#25c3eeb8941881be10829f5a78e91bf0e7d6f0a5202f1e3dcbcd617af7a13eee The problem has been mitigated, however some clients may still experience occasional timeouts and hightened error rates. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:32:00 -0000 https://www.luigisboxstatus.com/incident/302463#25c3eeb8941881be10829f5a78e91bf0e7d6f0a5202f1e3dcbcd617af7a13eee The problem has been mitigated, however some clients may still experience occasional timeouts and hightened error rates. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:32:00 -0000 https://www.luigisboxstatus.com/incident/302463#25c3eeb8941881be10829f5a78e91bf0e7d6f0a5202f1e3dcbcd617af7a13eee The problem has been mitigated, however some clients may still experience occasional timeouts and hightened error rates. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:28:00 -0000 https://www.luigisboxstatus.com/incident/302463#de37dde8075854070a004211d667b5c6351c14d675ced981bf8942a9e568cdb2 We are investigating source of increased latency and elevated error rates. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:28:00 -0000 https://www.luigisboxstatus.com/incident/302463#de37dde8075854070a004211d667b5c6351c14d675ced981bf8942a9e568cdb2 We are investigating source of increased latency and elevated error rates. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:28:00 -0000 https://www.luigisboxstatus.com/incident/302463#de37dde8075854070a004211d667b5c6351c14d675ced981bf8942a9e568cdb2 We are investigating source of increased latency and elevated error rates. Increased latency and error rates https://www.luigisboxstatus.com/incident/302463 Tue, 19 Dec 2023 11:28:00 -0000 https://www.luigisboxstatus.com/incident/302463#de37dde8075854070a004211d667b5c6351c14d675ced981bf8942a9e568cdb2 We are investigating source of increased latency and elevated error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:11:00 -0000 https://www.luigisboxstatus.com/incident/302485#2b6abd84807b5f3a5e3c677c464a65fb72d437d5413c87a228bd4c52347e3c63 Latencies and error rates are back to nominal values. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:11:00 -0000 https://www.luigisboxstatus.com/incident/302485#2b6abd84807b5f3a5e3c677c464a65fb72d437d5413c87a228bd4c52347e3c63 Latencies and error rates are back to nominal values. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:11:00 -0000 https://www.luigisboxstatus.com/incident/302485#2b6abd84807b5f3a5e3c677c464a65fb72d437d5413c87a228bd4c52347e3c63 Latencies and error rates are back to nominal values. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:11:00 -0000 https://www.luigisboxstatus.com/incident/302485#2b6abd84807b5f3a5e3c677c464a65fb72d437d5413c87a228bd4c52347e3c63 Latencies and error rates are back to nominal values. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:04:00 -0000 https://www.luigisboxstatus.com/incident/302485#10abf4b8b1c019220405d6392623e896703042db991c3b1ddb13aca4647baf99 We have identified a problem with gateway nodes to the catalog storage. Affected nodes have been restarted, however some clients may still experience occasional timeouts and hightened error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:04:00 -0000 https://www.luigisboxstatus.com/incident/302485#10abf4b8b1c019220405d6392623e896703042db991c3b1ddb13aca4647baf99 We have identified a problem with gateway nodes to the catalog storage. Affected nodes have been restarted, however some clients may still experience occasional timeouts and hightened error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:04:00 -0000 https://www.luigisboxstatus.com/incident/302485#10abf4b8b1c019220405d6392623e896703042db991c3b1ddb13aca4647baf99 We have identified a problem with gateway nodes to the catalog storage. Affected nodes have been restarted, however some clients may still experience occasional timeouts and hightened error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 09:04:00 -0000 https://www.luigisboxstatus.com/incident/302485#10abf4b8b1c019220405d6392623e896703042db991c3b1ddb13aca4647baf99 We have identified a problem with gateway nodes to the catalog storage. Affected nodes have been restarted, however some clients may still experience occasional timeouts and hightened error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 08:59:00 -0000 https://www.luigisboxstatus.com/incident/302485#327f6dd67944c2c2b816938024ed70376e40b93a4a2f01d5a90ee1b2dfe140e2 We are investigating source of increased latency and elevated error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 08:59:00 -0000 https://www.luigisboxstatus.com/incident/302485#327f6dd67944c2c2b816938024ed70376e40b93a4a2f01d5a90ee1b2dfe140e2 We are investigating source of increased latency and elevated error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 08:59:00 -0000 https://www.luigisboxstatus.com/incident/302485#327f6dd67944c2c2b816938024ed70376e40b93a4a2f01d5a90ee1b2dfe140e2 We are investigating source of increased latency and elevated error rates. Increased latencies and error rates https://www.luigisboxstatus.com/incident/302485 Mon, 18 Dec 2023 08:59:00 -0000 https://www.luigisboxstatus.com/incident/302485#327f6dd67944c2c2b816938024ed70376e40b93a4a2f01d5a90ee1b2dfe140e2 We are investigating source of increased latency and elevated error rates. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:47:00 -0000 https://www.luigisboxstatus.com/incident/288022#8c20205c31a5a25ae434772674fec9bcfc8bbcdc54681a3e46be3d16d9cc0c23 Catalog synchronizations backlog has been cleared and is finally processed. We are actively monitoring the situation and working on preventing the issue occurring in the future. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:47:00 -0000 https://www.luigisboxstatus.com/incident/288022#8c20205c31a5a25ae434772674fec9bcfc8bbcdc54681a3e46be3d16d9cc0c23 Catalog synchronizations backlog has been cleared and is finally processed. We are actively monitoring the situation and working on preventing the issue occurring in the future. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:47:00 -0000 https://www.luigisboxstatus.com/incident/288022#8c20205c31a5a25ae434772674fec9bcfc8bbcdc54681a3e46be3d16d9cc0c23 Catalog synchronizations backlog has been cleared and is finally processed. We are actively monitoring the situation and working on preventing the issue occurring in the future. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:47:00 -0000 https://www.luigisboxstatus.com/incident/288022#8c20205c31a5a25ae434772674fec9bcfc8bbcdc54681a3e46be3d16d9cc0c23 Catalog synchronizations backlog has been cleared and is finally processed. We are actively monitoring the situation and working on preventing the issue occurring in the future. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:47:00 -0000 https://www.luigisboxstatus.com/incident/288022#8c20205c31a5a25ae434772674fec9bcfc8bbcdc54681a3e46be3d16d9cc0c23 Catalog synchronizations backlog has been cleared and is finally processed. We are actively monitoring the situation and working on preventing the issue occurring in the future. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:47:00 -0000 https://www.luigisboxstatus.com/incident/288022#8c20205c31a5a25ae434772674fec9bcfc8bbcdc54681a3e46be3d16d9cc0c23 Catalog synchronizations backlog has been cleared and is finally processed. We are actively monitoring the situation and working on preventing the issue occurring in the future. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:47:00 -0000 https://www.luigisboxstatus.com/incident/288022#8c20205c31a5a25ae434772674fec9bcfc8bbcdc54681a3e46be3d16d9cc0c23 Catalog synchronizations backlog has been cleared and is finally processed. We are actively monitoring the situation and working on preventing the issue occurring in the future. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:15:00 -0000 https://www.luigisboxstatus.com/incident/288022#44dee47e9084da52cc2c8ba8ba32660a3fb276f2ac1883736889d7855e66e80b We have successfully restored functionality of the affected subsystem. All services are operational with continuing delays with catalog synchronization until our backlog of tasks clears up. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:15:00 -0000 https://www.luigisboxstatus.com/incident/288022#44dee47e9084da52cc2c8ba8ba32660a3fb276f2ac1883736889d7855e66e80b We have successfully restored functionality of the affected subsystem. All services are operational with continuing delays with catalog synchronization until our backlog of tasks clears up. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:15:00 -0000 https://www.luigisboxstatus.com/incident/288022#44dee47e9084da52cc2c8ba8ba32660a3fb276f2ac1883736889d7855e66e80b We have successfully restored functionality of the affected subsystem. All services are operational with continuing delays with catalog synchronization until our backlog of tasks clears up. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:15:00 -0000 https://www.luigisboxstatus.com/incident/288022#44dee47e9084da52cc2c8ba8ba32660a3fb276f2ac1883736889d7855e66e80b We have successfully restored functionality of the affected subsystem. All services are operational with continuing delays with catalog synchronization until our backlog of tasks clears up. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:15:00 -0000 https://www.luigisboxstatus.com/incident/288022#44dee47e9084da52cc2c8ba8ba32660a3fb276f2ac1883736889d7855e66e80b We have successfully restored functionality of the affected subsystem. All services are operational with continuing delays with catalog synchronization until our backlog of tasks clears up. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:15:00 -0000 https://www.luigisboxstatus.com/incident/288022#44dee47e9084da52cc2c8ba8ba32660a3fb276f2ac1883736889d7855e66e80b We have successfully restored functionality of the affected subsystem. All services are operational with continuing delays with catalog synchronization until our backlog of tasks clears up. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 13:15:00 -0000 https://www.luigisboxstatus.com/incident/288022#44dee47e9084da52cc2c8ba8ba32660a3fb276f2ac1883736889d7855e66e80b We have successfully restored functionality of the affected subsystem. All services are operational with continuing delays with catalog synchronization until our backlog of tasks clears up. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 12:49:00 -0000 https://www.luigisboxstatus.com/incident/288022#c6ab89d085ade944440eba55b98ba5daf79e80d6e547058a151e1dda03e2134d Affected subsystem failed completely and we are attempting to mitigate the issue. Search, autocomplete and product listing latency and error rates might be hightened for the time being. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 12:49:00 -0000 https://www.luigisboxstatus.com/incident/288022#c6ab89d085ade944440eba55b98ba5daf79e80d6e547058a151e1dda03e2134d Affected subsystem failed completely and we are attempting to mitigate the issue. Search, autocomplete and product listing latency and error rates might be hightened for the time being. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 12:49:00 -0000 https://www.luigisboxstatus.com/incident/288022#c6ab89d085ade944440eba55b98ba5daf79e80d6e547058a151e1dda03e2134d Affected subsystem failed completely and we are attempting to mitigate the issue. Search, autocomplete and product listing latency and error rates might be hightened for the time being. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 12:49:00 -0000 https://www.luigisboxstatus.com/incident/288022#c6ab89d085ade944440eba55b98ba5daf79e80d6e547058a151e1dda03e2134d Affected subsystem failed completely and we are attempting to mitigate the issue. Search, autocomplete and product listing latency and error rates might be hightened for the time being. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 12:49:00 -0000 https://www.luigisboxstatus.com/incident/288022#c6ab89d085ade944440eba55b98ba5daf79e80d6e547058a151e1dda03e2134d Affected subsystem failed completely and we are attempting to mitigate the issue. Search, autocomplete and product listing latency and error rates might be hightened for the time being. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 12:49:00 -0000 https://www.luigisboxstatus.com/incident/288022#c6ab89d085ade944440eba55b98ba5daf79e80d6e547058a151e1dda03e2134d Affected subsystem failed completely and we are attempting to mitigate the issue. Search, autocomplete and product listing latency and error rates might be hightened for the time being. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 12:49:00 -0000 https://www.luigisboxstatus.com/incident/288022#c6ab89d085ade944440eba55b98ba5daf79e80d6e547058a151e1dda03e2134d Affected subsystem failed completely and we are attempting to mitigate the issue. Search, autocomplete and product listing latency and error rates might be hightened for the time being. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 11:00:00 -0000 https://www.luigisboxstatus.com/incident/288022#3728fe60cd75428a013e1c6f1a5afa51e84e732c223a4f4a0eb39d45b90905e0 We are experiencing multiple issues with one of our storage subsystems causing delays in catalog synchronization for clients.We have identified the problematic subsystem and are mitigating the issue. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 11:00:00 -0000 https://www.luigisboxstatus.com/incident/288022#3728fe60cd75428a013e1c6f1a5afa51e84e732c223a4f4a0eb39d45b90905e0 We are experiencing multiple issues with one of our storage subsystems causing delays in catalog synchronization for clients.We have identified the problematic subsystem and are mitigating the issue. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 11:00:00 -0000 https://www.luigisboxstatus.com/incident/288022#3728fe60cd75428a013e1c6f1a5afa51e84e732c223a4f4a0eb39d45b90905e0 We are experiencing multiple issues with one of our storage subsystems causing delays in catalog synchronization for clients.We have identified the problematic subsystem and are mitigating the issue. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 11:00:00 -0000 https://www.luigisboxstatus.com/incident/288022#3728fe60cd75428a013e1c6f1a5afa51e84e732c223a4f4a0eb39d45b90905e0 We are experiencing multiple issues with one of our storage subsystems causing delays in catalog synchronization for clients.We have identified the problematic subsystem and are mitigating the issue. Storage subsystem failure affecting all services https://www.luigisboxstatus.com/incident/288022 Thu, 16 Nov 2023 11:00:00 -0000 https://www.luigisboxstatus.com/incident/288022#3728fe60cd75428a013e1c6f1a5afa51e84e732c223a4f4a0eb39d45b90905e0 We are experiencing multiple issues with one of our storage subsystems causing delays in catalog synchronization for clients.We have identified the problematic subsystem and are mitigating the issue. Increased latency and error rate https://www.luigisboxstatus.com/incident/275030 Thu, 19 Oct 2023 19:21:00 -0000 https://www.luigisboxstatus.com/incident/275030#36721391a4ad4ba455a98346a118808939729bfaa1ab67a605b0474ebfa7112d Latencies and error rates are back to nominal values. Increased latency and error rate https://www.luigisboxstatus.com/incident/275030 Thu, 19 Oct 2023 18:45:00 -0000 https://www.luigisboxstatus.com/incident/275030#8152473a5744207b17074b48eb4f01a519a6cb70f38c9f2e48b0d148459ff098 We are investigating source of increased latency and elevated error rates. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:15:00 -0000 https://www.luigisboxstatus.com/incident/234271#319c6d256ceba6223d254e6da14e8cdee2b4fa51f1b2ce65ae7c5a117822177a All issues have been resolved and we are closely monitoring the situation. Catalog data will update according to individual schedule of each and every one. Thank you for your patience. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:15:00 -0000 https://www.luigisboxstatus.com/incident/234271#319c6d256ceba6223d254e6da14e8cdee2b4fa51f1b2ce65ae7c5a117822177a All issues have been resolved and we are closely monitoring the situation. Catalog data will update according to individual schedule of each and every one. Thank you for your patience. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:15:00 -0000 https://www.luigisboxstatus.com/incident/234271#319c6d256ceba6223d254e6da14e8cdee2b4fa51f1b2ce65ae7c5a117822177a All issues have been resolved and we are closely monitoring the situation. Catalog data will update according to individual schedule of each and every one. Thank you for your patience. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:15:00 -0000 https://www.luigisboxstatus.com/incident/234271#319c6d256ceba6223d254e6da14e8cdee2b4fa51f1b2ce65ae7c5a117822177a All issues have been resolved and we are closely monitoring the situation. Catalog data will update according to individual schedule of each and every one. Thank you for your patience. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:08:00 -0000 https://www.luigisboxstatus.com/incident/234271#1971944520373cd458625c3caacaf4dbb8830f9e0df2854d79b738ad84537c02 Feeds processing has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:08:00 -0000 https://www.luigisboxstatus.com/incident/234271#1971944520373cd458625c3caacaf4dbb8830f9e0df2854d79b738ad84537c02 Feeds processing has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:08:00 -0000 https://www.luigisboxstatus.com/incident/234271#1971944520373cd458625c3caacaf4dbb8830f9e0df2854d79b738ad84537c02 Feeds processing has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:08:00 -0000 https://www.luigisboxstatus.com/incident/234271#1971944520373cd458625c3caacaf4dbb8830f9e0df2854d79b738ad84537c02 Feeds processing has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:01:00 -0000 https://www.luigisboxstatus.com/incident/234271#322cd347e84128827f9ef3dcdf334fd78d27515156c2f21c66c0e5525913a736 Shopware catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:01:00 -0000 https://www.luigisboxstatus.com/incident/234271#322cd347e84128827f9ef3dcdf334fd78d27515156c2f21c66c0e5525913a736 Shopware catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:01:00 -0000 https://www.luigisboxstatus.com/incident/234271#322cd347e84128827f9ef3dcdf334fd78d27515156c2f21c66c0e5525913a736 Shopware catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 10:01:00 -0000 https://www.luigisboxstatus.com/incident/234271#322cd347e84128827f9ef3dcdf334fd78d27515156c2f21c66c0e5525913a736 Shopware catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:46:00 -0000 https://www.luigisboxstatus.com/incident/234271#b7c13a86fb5e8d652a385662e45e5c80e5bcdb0eb1e6ae7a2fe9356afd11d17d Shoptet catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:46:00 -0000 https://www.luigisboxstatus.com/incident/234271#b7c13a86fb5e8d652a385662e45e5c80e5bcdb0eb1e6ae7a2fe9356afd11d17d Shoptet catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:46:00 -0000 https://www.luigisboxstatus.com/incident/234271#b7c13a86fb5e8d652a385662e45e5c80e5bcdb0eb1e6ae7a2fe9356afd11d17d Shoptet catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:46:00 -0000 https://www.luigisboxstatus.com/incident/234271#b7c13a86fb5e8d652a385662e45e5c80e5bcdb0eb1e6ae7a2fe9356afd11d17d Shoptet catalog synchronization has been restored and will update catalog changes according to synchronization schedule. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:38:00 -0000 https://www.luigisboxstatus.com/incident/234271#c75413d9b2a0c2ea15a511dd2317c2f6f0fb7326dadc0a79901980201acd9cd1 Shopify catalog synchronization has been restored and timely updates catalog changes. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:38:00 -0000 https://www.luigisboxstatus.com/incident/234271#c75413d9b2a0c2ea15a511dd2317c2f6f0fb7326dadc0a79901980201acd9cd1 Shopify catalog synchronization has been restored and timely updates catalog changes. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:38:00 -0000 https://www.luigisboxstatus.com/incident/234271#c75413d9b2a0c2ea15a511dd2317c2f6f0fb7326dadc0a79901980201acd9cd1 Shopify catalog synchronization has been restored and timely updates catalog changes. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:38:00 -0000 https://www.luigisboxstatus.com/incident/234271#c75413d9b2a0c2ea15a511dd2317c2f6f0fb7326dadc0a79901980201acd9cd1 Shopify catalog synchronization has been restored and timely updates catalog changes. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:18:00 -0000 https://www.luigisboxstatus.com/incident/234271#f5ee16c7f187fe606f106952f6b6880f331e632caaac4746e83032845273644e We are experiencing problems with delay of synchronization jobs. Our team is investigating and we will provide further updates. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:18:00 -0000 https://www.luigisboxstatus.com/incident/234271#f5ee16c7f187fe606f106952f6b6880f331e632caaac4746e83032845273644e We are experiencing problems with delay of synchronization jobs. Our team is investigating and we will provide further updates. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:18:00 -0000 https://www.luigisboxstatus.com/incident/234271#f5ee16c7f187fe606f106952f6b6880f331e632caaac4746e83032845273644e We are experiencing problems with delay of synchronization jobs. Our team is investigating and we will provide further updates. Synchronization jobs delay https://www.luigisboxstatus.com/incident/234271 Tue, 18 Jul 2023 09:18:00 -0000 https://www.luigisboxstatus.com/incident/234271#f5ee16c7f187fe606f106952f6b6880f331e632caaac4746e83032845273644e We are experiencing problems with delay of synchronization jobs. Our team is investigating and we will provide further updates. Analytics storage migration https://www.luigisboxstatus.com/incident/225242 Tue, 27 Jun 2023 16:00:00 +0000 https://www.luigisboxstatus.com/incident/225242#fefbf02c5938b2507db927e390f38f9a76d1f2f18a7a30d24ae06a451e476c93 Maintenance completed Analytics storage migration https://www.luigisboxstatus.com/incident/225242 Tue, 27 Jun 2023 08:30:00 -0000 https://www.luigisboxstatus.com/incident/225242#3e1b99bb6d2190df3e59e5551f883d608dbb8a14fdca5fa185fc20b379dacf14 In light of numerous outages in the last few weeks, we will be migrating our analytics storage for higher reliability and better customer experience throughout the day. Expect possibly higher error rates or lower performance than usual, in the worst case. We are very sorry for the inconvenience. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/224763 Mon, 26 Jun 2023 11:25:00 -0000 https://www.luigisboxstatus.com/incident/224763#15ed92a0db0a09a101dd9cdaa021e6b388f2d74c47e5e16b03a11d890b53148f Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/224763 Mon, 26 Jun 2023 07:46:00 -0000 https://www.luigisboxstatus.com/incident/224763#560da96e4a619909fc1964edd78c88fa5cbcbcbd50f583dce2ef4e40b244a749 We have identified an issue causing degraded performance of our in-app analytics services and analytics API endpoints. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/222616 Tue, 20 Jun 2023 16:53:00 -0000 https://www.luigisboxstatus.com/incident/222616#16f6166586daf1f28d6569066c726be41e2e0a0718875f89fa9eb3f7969ec6de Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/222616 Tue, 20 Jun 2023 14:33:00 -0000 https://www.luigisboxstatus.com/incident/222616#969c8e1ab69b6df18a0774779a6b95f33a259c5d7532e2e8a74effda5fc40a46 We have identified an issue causing degraded performance of our in-app analytics services and analytics API endpoints. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:48:00 -0000 https://www.luigisboxstatus.com/incident/220064#5092ca46ece5016fdeb04a842c43f59aaeb207b437ad63c00c9e80f5289e3aa1 Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:48:00 -0000 https://www.luigisboxstatus.com/incident/220064#5092ca46ece5016fdeb04a842c43f59aaeb207b437ad63c00c9e80f5289e3aa1 Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:48:00 -0000 https://www.luigisboxstatus.com/incident/220064#5092ca46ece5016fdeb04a842c43f59aaeb207b437ad63c00c9e80f5289e3aa1 Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:48:00 -0000 https://www.luigisboxstatus.com/incident/220064#5092ca46ece5016fdeb04a842c43f59aaeb207b437ad63c00c9e80f5289e3aa1 Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:19:00 -0000 https://www.luigisboxstatus.com/incident/220064#bdf7b98ac9baeda3b6743c8841ae1c6450ae0f9451538de6f54022d8052188ca Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:19:00 -0000 https://www.luigisboxstatus.com/incident/220064#bdf7b98ac9baeda3b6743c8841ae1c6450ae0f9451538de6f54022d8052188ca Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:19:00 -0000 https://www.luigisboxstatus.com/incident/220064#bdf7b98ac9baeda3b6743c8841ae1c6450ae0f9451538de6f54022d8052188ca Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 11:19:00 -0000 https://www.luigisboxstatus.com/incident/220064#bdf7b98ac9baeda3b6743c8841ae1c6450ae0f9451538de6f54022d8052188ca Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 10:10:00 -0000 https://www.luigisboxstatus.com/incident/220064#6a6bb6bdb59a6d1916bca47fe8aee64bf3df35672d56447e3bcddb07db8b53e6 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 10:10:00 -0000 https://www.luigisboxstatus.com/incident/220064#6a6bb6bdb59a6d1916bca47fe8aee64bf3df35672d56447e3bcddb07db8b53e6 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 10:10:00 -0000 https://www.luigisboxstatus.com/incident/220064#6a6bb6bdb59a6d1916bca47fe8aee64bf3df35672d56447e3bcddb07db8b53e6 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/220064 Wed, 14 Jun 2023 10:10:00 -0000 https://www.luigisboxstatus.com/incident/220064#6a6bb6bdb59a6d1916bca47fe8aee64bf3df35672d56447e3bcddb07db8b53e6 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/219093 Mon, 12 Jun 2023 14:14:00 -0000 https://www.luigisboxstatus.com/incident/219093#5bfed6ba88586d8909996e7fee781f3356d426e29dcab85a7288558701cc427a Latencies and error rate are back at the nominal level and services are stable. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/219093 Mon, 12 Jun 2023 10:16:00 -0000 https://www.luigisboxstatus.com/incident/219093#092d81c6f496e3a876c2e065a462d5cda707c22c39831b444359b9be42906dcf We have identified an issue causing degraded performance of our in-app analytics services and analytics API endpoints. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/217178 Wed, 07 Jun 2023 11:38:00 -0000 https://www.luigisboxstatus.com/incident/217178#e2746aafb67a1fb2d90cdaed7f1317dae481041adb816a7a6155b1f576f80165 Latencies and error rate are back at the nominal level and services are stable. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/217178 Wed, 07 Jun 2023 10:52:00 -0000 https://www.luigisboxstatus.com/incident/217178#0d33d0ae5a6d4462a21f8cdcd153a82a0c5208ebb04821044a78c113a612baa5 We have identified an issue causing degraded performance of our in-app analytics services and analytics API endpoints. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/212334 Fri, 26 May 2023 09:27:00 -0000 https://www.luigisboxstatus.com/incident/212334#afaecd08dbfe85dc03734c4ec95fdb4e5f410dab763d0de4551789215b073b9f Latencies and error rate are back at the nominal level and services are stable. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/212334 Fri, 26 May 2023 09:20:00 -0000 https://www.luigisboxstatus.com/incident/212334#91d11a92ce41f79460c0ede4b97f08628c1385575b93370f3904b24bc94f81f3 We have identified an issue causing degraded performance of our in-app analytics services and analytics API endpoints. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/211337 Wed, 24 May 2023 07:00:00 -0000 https://www.luigisboxstatus.com/incident/211337#b12a2b199dc985c31be285e80310f2027e65780e2bc0ae3054eb0c11cad82b4a Latencies and error rate are back at the nominal level and services are stable. Increased Analytics latency and error rate https://www.luigisboxstatus.com/incident/211337 Wed, 24 May 2023 06:53:00 -0000 https://www.luigisboxstatus.com/incident/211337#0587828c416b4dedcbb747da04522ae362d3e7f16f22dd795ab4c1512172e6b9 We have identified an issue causing degraded performance of our in-app analytics services and analytics API endpoints. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 11:05:00 -0000 https://www.luigisboxstatus.com/incident/210495#ba0e5adbaf93b2d574fb3e6defe6ac2c2018fc2233a7a9da6714b79847eee30a Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 11:05:00 -0000 https://www.luigisboxstatus.com/incident/210495#ba0e5adbaf93b2d574fb3e6defe6ac2c2018fc2233a7a9da6714b79847eee30a Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 11:05:00 -0000 https://www.luigisboxstatus.com/incident/210495#ba0e5adbaf93b2d574fb3e6defe6ac2c2018fc2233a7a9da6714b79847eee30a Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 11:05:00 -0000 https://www.luigisboxstatus.com/incident/210495#ba0e5adbaf93b2d574fb3e6defe6ac2c2018fc2233a7a9da6714b79847eee30a Latencies and error rate are back at the nominal level and services are stable. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:56:00 -0000 https://www.luigisboxstatus.com/incident/210495#f1472ef8d2327e6d40ca618b8d999122026af90d374985d8644c2b8119b1781b Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:56:00 -0000 https://www.luigisboxstatus.com/incident/210495#f1472ef8d2327e6d40ca618b8d999122026af90d374985d8644c2b8119b1781b Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:56:00 -0000 https://www.luigisboxstatus.com/incident/210495#f1472ef8d2327e6d40ca618b8d999122026af90d374985d8644c2b8119b1781b Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:56:00 -0000 https://www.luigisboxstatus.com/incident/210495#f1472ef8d2327e6d40ca618b8d999122026af90d374985d8644c2b8119b1781b Services regained stability and latencies across all services are back to normal. We are monitoring the situation. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:41:00 -0000 https://www.luigisboxstatus.com/incident/210495#fc4ab0b2829ebf59337c61b222d77ef5d3b1bc5c15e5767e3e5c6981357d2ed2 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:41:00 -0000 https://www.luigisboxstatus.com/incident/210495#fc4ab0b2829ebf59337c61b222d77ef5d3b1bc5c15e5767e3e5c6981357d2ed2 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:41:00 -0000 https://www.luigisboxstatus.com/incident/210495#fc4ab0b2829ebf59337c61b222d77ef5d3b1bc5c15e5767e3e5c6981357d2ed2 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased search, autocomplete, recommender and content updates latencies https://www.luigisboxstatus.com/incident/210495 Mon, 22 May 2023 10:41:00 -0000 https://www.luigisboxstatus.com/incident/210495#fc4ab0b2829ebf59337c61b222d77ef5d3b1bc5c15e5767e3e5c6981357d2ed2 We are experiencing multiple problems with our services connected to the catalog data storage. Our team is investigating and we will provide further updates. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:34:00 -0000 https://www.luigisboxstatus.com/incident/172240#dedc87e2413010c7bd5a3ac69ce0240bb2911a8a61435e4e3cd890aea627dd63 Latencies and error rate are back at the nominal level and service is stable. We are still monitoring the service, and will be conducting a post-mortem to better understand the root cause and prevent it in the future. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:34:00 -0000 https://www.luigisboxstatus.com/incident/172240#dedc87e2413010c7bd5a3ac69ce0240bb2911a8a61435e4e3cd890aea627dd63 Latencies and error rate are back at the nominal level and service is stable. We are still monitoring the service, and will be conducting a post-mortem to better understand the root cause and prevent it in the future. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:34:00 -0000 https://www.luigisboxstatus.com/incident/172240#dedc87e2413010c7bd5a3ac69ce0240bb2911a8a61435e4e3cd890aea627dd63 Latencies and error rate are back at the nominal level and service is stable. We are still monitoring the service, and will be conducting a post-mortem to better understand the root cause and prevent it in the future. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:14:00 -0000 https://www.luigisboxstatus.com/incident/172240#e5d065644f555963d9c20e72d2af59ee7103f19468050a58e15610a12d9d5edd We are back at the pre-incident latencies and see no more errors. We are overseeing resource re-allocation, before declaring this incident over. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:14:00 -0000 https://www.luigisboxstatus.com/incident/172240#e5d065644f555963d9c20e72d2af59ee7103f19468050a58e15610a12d9d5edd We are back at the pre-incident latencies and see no more errors. We are overseeing resource re-allocation, before declaring this incident over. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:14:00 -0000 https://www.luigisboxstatus.com/incident/172240#e5d065644f555963d9c20e72d2af59ee7103f19468050a58e15610a12d9d5edd We are back at the pre-incident latencies and see no more errors. We are overseeing resource re-allocation, before declaring this incident over. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:02:00 -0000 https://www.luigisboxstatus.com/incident/172240#f95162729fd3effd39d188047a41dcd1fe8378b2b1d30d0bf5fc3472d363c775 We continue adding hardware and see that the latencies and error rate are getting back to normal. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:02:00 -0000 https://www.luigisboxstatus.com/incident/172240#f95162729fd3effd39d188047a41dcd1fe8378b2b1d30d0bf5fc3472d363c775 We continue adding hardware and see that the latencies and error rate are getting back to normal. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 16:02:00 -0000 https://www.luigisboxstatus.com/incident/172240#f95162729fd3effd39d188047a41dcd1fe8378b2b1d30d0bf5fc3472d363c775 We continue adding hardware and see that the latencies and error rate are getting back to normal. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 15:35:00 -0000 https://www.luigisboxstatus.com/incident/172240#60fe78aff01a5310c6948b02e904f6c46fc541ae7d77c06f976f2f7a8eaf687e During a planned hardware migration, we have erroneously allocated a subset of clients to an under-provisioned hardware, which led to latency and error rate increase. We are adding more hardware to mitigate the situation. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 15:35:00 -0000 https://www.luigisboxstatus.com/incident/172240#60fe78aff01a5310c6948b02e904f6c46fc541ae7d77c06f976f2f7a8eaf687e During a planned hardware migration, we have erroneously allocated a subset of clients to an under-provisioned hardware, which led to latency and error rate increase. We are adding more hardware to mitigate the situation. Increased search and content updates latencies https://www.luigisboxstatus.com/incident/172240 Mon, 06 Feb 2023 15:35:00 -0000 https://www.luigisboxstatus.com/incident/172240#60fe78aff01a5310c6948b02e904f6c46fc541ae7d77c06f976f2f7a8eaf687e During a planned hardware migration, we have erroneously allocated a subset of clients to an under-provisioned hardware, which led to latency and error rate increase. We are adding more hardware to mitigate the situation. Increased latency and error rate https://www.luigisboxstatus.com/incident/93925 Fri, 03 Jun 2022 07:30:00 -0000 https://www.luigisboxstatus.com/incident/93925#c6348b09dfaec99751681a6f12abd54098a8b0fd05b17545129031ed81c14c7f We have identified the root cause and applied a fix. Increased latency and error rate https://www.luigisboxstatus.com/incident/93925 Fri, 03 Jun 2022 06:30:00 -0000 https://www.luigisboxstatus.com/incident/93925#a93ba97436d2e6ee43dcd530444916513c233eb12eb0a1521a5e77e7ba24a498 Recommender service is reporting increased latency and error rates. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:08:00 -0000 https://www.luigisboxstatus.com/incident/87812#ff6e3ded3ebe05b6456ed1171116661fe80a37e63a04ca82471c45598b3a54d4 We have reverted the network configuration and are investigating the cause. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:08:00 -0000 https://www.luigisboxstatus.com/incident/87812#ff6e3ded3ebe05b6456ed1171116661fe80a37e63a04ca82471c45598b3a54d4 We have reverted the network configuration and are investigating the cause. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:08:00 -0000 https://www.luigisboxstatus.com/incident/87812#ff6e3ded3ebe05b6456ed1171116661fe80a37e63a04ca82471c45598b3a54d4 We have reverted the network configuration and are investigating the cause. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:08:00 -0000 https://www.luigisboxstatus.com/incident/87812#ff6e3ded3ebe05b6456ed1171116661fe80a37e63a04ca82471c45598b3a54d4 We have reverted the network configuration and are investigating the cause. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:02:00 -0000 https://www.luigisboxstatus.com/incident/87812#1f89c77f99eafb1d334d40d4d52c05fa2375b3697c4815cc1cd80c87bcb5bfeb We are currently having network connectivity issues, and are rolling back the configuration changes. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:02:00 -0000 https://www.luigisboxstatus.com/incident/87812#1f89c77f99eafb1d334d40d4d52c05fa2375b3697c4815cc1cd80c87bcb5bfeb We are currently having network connectivity issues, and are rolling back the configuration changes. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:02:00 -0000 https://www.luigisboxstatus.com/incident/87812#1f89c77f99eafb1d334d40d4d52c05fa2375b3697c4815cc1cd80c87bcb5bfeb We are currently having network connectivity issues, and are rolling back the configuration changes. All services unavailable due to internal networking problem https://www.luigisboxstatus.com/incident/87812 Fri, 13 May 2022 10:02:00 -0000 https://www.luigisboxstatus.com/incident/87812#1f89c77f99eafb1d334d40d4d52c05fa2375b3697c4815cc1cd80c87bcb5bfeb We are currently having network connectivity issues, and are rolling back the configuration changes. Increased latency and error rate https://www.luigisboxstatus.com/incident/86826 Mon, 09 May 2022 17:34:00 -0000 https://www.luigisboxstatus.com/incident/86826#fc9339b249afde79bdc9ca789de17a473cb8c85f9a60de089af2d3e37df1fdc1 We have managed to get the latency and error rate back to normal and are investigating root cause. Increased latency and error rate https://www.luigisboxstatus.com/incident/86826 Mon, 09 May 2022 17:34:00 -0000 https://www.luigisboxstatus.com/incident/86826#fc9339b249afde79bdc9ca789de17a473cb8c85f9a60de089af2d3e37df1fdc1 We have managed to get the latency and error rate back to normal and are investigating root cause. Increased latency and error rate https://www.luigisboxstatus.com/incident/86826 Mon, 09 May 2022 17:06:00 -0000 https://www.luigisboxstatus.com/incident/86826#1349a33544de0eab92518ce0408c3714eb92f99b1bf90d192c32257bcdfec333 We are investigating increased latency and error rates for a subset of clients. Increased latency and error rate https://www.luigisboxstatus.com/incident/86826 Mon, 09 May 2022 17:06:00 -0000 https://www.luigisboxstatus.com/incident/86826#1349a33544de0eab92518ce0408c3714eb92f99b1bf90d192c32257bcdfec333 We are investigating increased latency and error rates for a subset of clients. Increased latency https://www.luigisboxstatus.com/incident/86792 Mon, 09 May 2022 13:39:00 -0000 https://www.luigisboxstatus.com/incident/86792#903de95fb3185e22e1882fa8fe9f36d50d05c88a552fd717cb9c0b7d08d5c6fa We have identified and fixed the cause of this issue. Latency is back to normal. Increased latency https://www.luigisboxstatus.com/incident/86792 Mon, 09 May 2022 13:39:00 -0000 https://www.luigisboxstatus.com/incident/86792#903de95fb3185e22e1882fa8fe9f36d50d05c88a552fd717cb9c0b7d08d5c6fa We have identified and fixed the cause of this issue. Latency is back to normal. Increased latency https://www.luigisboxstatus.com/incident/86792 Mon, 09 May 2022 13:23:00 -0000 https://www.luigisboxstatus.com/incident/86792#4cf8433229aa26150f787cb31357f715e30294d21eb0406900f9e550aaed1ecd We are investigating reports of increased search and recommender latencies. Increased latency https://www.luigisboxstatus.com/incident/86792 Mon, 09 May 2022 13:23:00 -0000 https://www.luigisboxstatus.com/incident/86792#4cf8433229aa26150f787cb31357f715e30294d21eb0406900f9e550aaed1ecd We are investigating reports of increased search and recommender latencies. Search and recommender unavaible https://www.luigisboxstatus.com/incident/79370 Fri, 01 Apr 2022 08:20:00 -0000 https://www.luigisboxstatus.com/incident/79370#12ccfab0b20b2f9c54a0793e19496a4e61005f099cfc6ba93f44877a76bec14c We took measures to stabilize the system and are looking for a root cause. Search and recommender unavaible https://www.luigisboxstatus.com/incident/79370 Fri, 01 Apr 2022 08:20:00 -0000 https://www.luigisboxstatus.com/incident/79370#12ccfab0b20b2f9c54a0793e19496a4e61005f099cfc6ba93f44877a76bec14c We took measures to stabilize the system and are looking for a root cause. Search and recommender unavaible https://www.luigisboxstatus.com/incident/79370 Fri, 01 Apr 2022 08:06:00 -0000 https://www.luigisboxstatus.com/incident/79370#dd6fa6908c55aa6559538e01fe22e391ef85f326162bad2b55bce9fa3d7ef76c Search and recommender API calls have increased latencies or time out. Search and recommender unavaible https://www.luigisboxstatus.com/incident/79370 Fri, 01 Apr 2022 08:06:00 -0000 https://www.luigisboxstatus.com/incident/79370#dd6fa6908c55aa6559538e01fe22e391ef85f326162bad2b55bce9fa3d7ef76c Search and recommender API calls have increased latencies or time out. Search unavailable for a subset of SHOPTET clients https://www.luigisboxstatus.com/incident/65915 Wed, 12 Jan 2022 14:27:00 -0000 https://www.luigisboxstatus.com/incident/65915#52f1476494897c64f417deb7ef7cd690f1cea9edce638746c420f1240d3d39dc We deployed the fix, search is operating normally. Search unavailable for a subset of SHOPTET clients https://www.luigisboxstatus.com/incident/65915 Wed, 12 Jan 2022 13:18:00 -0000 https://www.luigisboxstatus.com/incident/65915#d36ce7813e4743488afe6bbc3f9237f35873569dbd83180814f90d67ff80ac13 Search and autocomplete is unavailable for a subset of Shoptet clients. Around 20 clients are affected. We identified the root cause and are working on a fix. Search unavailable and timing out for subset of clients https://www.luigisboxstatus.com/incident/58830 Wed, 10 Nov 2021 12:52:14 -0000 https://www.luigisboxstatus.com/incident/58830#509985e64c979f81939a75f9431260486ea4178754e15a3b34f81ae6f4a2d08c We have identified the root cause and rolled out an update. Search unavailable and timing out for subset of clients https://www.luigisboxstatus.com/incident/58830 Wed, 10 Nov 2021 11:14:11 -0000 https://www.luigisboxstatus.com/incident/58830#608aedef9708231bc0d4409789f7fbc1f990ffa5c4a348329b6835a23781d222 We are investigating increased search latencies and timeouts for a subset of clients.