Ver Log ETL

2025-11-06 09:00:02,025 [INFO] Iniciando proceso ETL... 2025-11-06 09:00:02,025 [INFO] === INICIO ETL === 2025-11-06 09:00:02,025 [INFO] Paso 1: Extracción de datos 2025-11-06 09:00:02,025 [INFO] Iniciando extracción de cabeceras 2025-11-06 09:00:02,025 [INFO] Extrayendo órdenes desde linux_ordenes... 2025-11-06 09:00:02,026 [INFO] Intentando conectar a SQL Server... 2025-11-06 09:00:06,581 [INFO] Conexión SQL Server exitosa 2025-11-06 09:00:06,582 [INFO] Ejecutando consulta (últimos 30 días desde 2025-10-07): SELECT numero, cliente, vendedor, fecha_entrega, dias_restantes, estatus FROM dbo.linux_ordenes WHERE fecha_entrega >= ? 2025-11-06 09:00:10,293 [INFO] Extraídas 138 órdenes 2025-11-06 09:00:10,293 [INFO] [DEBUG] Columnas ordenes: ['numero', 'cliente', 'vendedor', 'fecha_entrega', 'dias_restantes', 'estatus'] 2025-11-06 09:00:10,293 [INFO] [DEBUG] dtypes ordenes: {'numero': dtype('O'), 'cliente': dtype('O'), 'vendedor': dtype('O'), 'fecha_entrega': dtype('O'), 'dias_restantes': dtype('int64'), 'estatus': dtype('O')} 2025-11-06 09:00:10,299 [INFO] [DEBUG] Nulos en fecha_entrega (ordenes) tras limpiar: 0 2025-11-06 09:00:10,404 [INFO] Iniciando extracción de líneas 2025-11-06 09:00:10,404 [INFO] Extrayendo pedidos desde linux_pedidos... 2025-11-06 09:00:10,404 [INFO] Intentando conectar a SQL Server... 2025-11-06 09:00:11,253 [INFO] Conexión SQL Server exitosa 2025-11-06 09:00:11,253 [INFO] Ejecutando consulta (últimos 30 días desde 2025-10-07): SELECT id, orden_id, clave, producto, unidad, cantidad, surtido, liq, saldo, fecha_entrega FROM dbo.linux_pedidos WHERE fecha_entrega >= ? 2025-11-06 09:06:53,003 [INFO] Extraídos 269 pedidos 2025-11-06 09:06:53,003 [INFO] [DEBUG] Columnas pedidos: ['id', 'orden_id', 'clave', 'producto', 'unidad', 'cantidad', 'surtido', 'liq', 'saldo', 'fecha_entrega'] 2025-11-06 09:06:53,003 [INFO] [DEBUG] dtypes pedidos: {'id': dtype('O'), 'orden_id': dtype('float64'), 'clave': dtype('O'), 'producto': dtype('O'), 'unidad': dtype('O'), 'cantidad': dtype('int64'), 'surtido': dtype('int64'), 'liq': dtype('int64'), 'saldo': dtype('int64'), 'fecha_entrega': dtype('O')} 2025-11-06 09:06:53,009 [INFO] [DEBUG] Nulos en fecha_entrega (pedidos) tras limpiar: 0 2025-11-06 09:06:53,106 [INFO] Extraídas 269 líneas 2025-11-06 09:06:53,106 [INFO] Extracción completada en 411.08s 2025-11-06 09:06:53,106 [INFO] Paso 2: Transformación de datos 2025-11-06 09:06:53,106 [INFO] Transformando datos de cabeceras 2025-11-06 09:06:53,107 [INFO] [DEBUG] Nulos por columna (cabeceras): {'numero': 0, 'cliente': 0, 'vendedor': 0, 'fecha_entrega': 0, 'dias_restantes': 0, 'estatus': 0} 2025-11-06 09:06:53,113 [INFO] Transformadas 138 cabeceras 2025-11-06 09:06:53,113 [INFO] [DEBUG] Ejemplo cabeceras transformadas (3): [{'id': '7423', 'numero': '7423', 'cliente': 'HUSSMANN TECHNOLOGIES CORPORATION OF AMERICA', 'vendedor': 'MARTIN TORRES', 'fecha_entrega': '2025-10-23', 'estatus': 'completado', 'dias_restantes': -14, 'prioridad': 'URGENTE'}, {'id': '7486', 'numero': '7486', 'cliente': 'JET VAN MONTERREY', 'vendedor': 'ERICKA IVONNE DELGADO HUERTA', 'fecha_entrega': '2025-10-22', 'estatus': 'completado', 'dias_restantes': -15, 'prioridad': 'URGENTE'}, {'id': '7375', 'numero': '7375', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2025-10-15', 'estatus': 'pendiente', 'dias_restantes': -22, 'prioridad': 'URGENTE'}] 2025-11-06 09:06:53,113 [INFO] Transformando datos de líneas 2025-11-06 09:06:53,114 [INFO] [DEBUG] Nulos por columna (lineas): {'id': 0, 'orden_id': 0, 'clave': 0, 'producto': 0, 'unidad': 0, 'cantidad': 0, 'surtido': 0, 'liq': 0, 'saldo': 0, 'fecha_entrega': 0} 2025-11-06 09:06:53,124 [INFO] Transformadas 269 líneas 2025-11-06 09:06:53,125 [INFO] [DEBUG] Ejemplo líneas transformadas (3): [{'id': '6328_8936', 'ID_UNICO': '6328_8936', 'orden_id': '6328.0', 'clave': '3180360', 'producto': 'TH318 SELLADOR PARABRISAS NEGRO 600 ML', 'unidad': 'PIEZA', 'cantidad': 100, 'surtido': 100, 'liq': 100, 'saldo': 0, 'fecha_entrega': '2025-12-31', 'dias_restantes': 55, 'entregado': 1, 'estatus': 'completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '6373_8992', 'ID_UNICO': '6373_8992', 'orden_id': '6373.0', 'clave': '361602', 'producto': 'SELF SEALER 616, WHITE 2 LT', 'unidad': 'LITRO', 'cantidad': 1762, 'surtido': 0, 'liq': 1762, 'saldo': 1762, 'fecha_entrega': '2025-12-31', 'dias_restantes': 55, 'entregado': 0, 'estatus': 'pendiente', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '6931_9861', 'ID_UNICO': '6931_9861', 'orden_id': '6931.0', 'clave': 'HOTMELTSLE662', 'producto': 'HOT MELT SLE 662', 'unidad': 'LB', 'cantidad': 920, 'surtido': 0, 'liq': 920, 'saldo': 920, 'fecha_entrega': '2025-11-17', 'dias_restantes': 11, 'entregado': 0, 'estatus': 'pendiente', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}] 2025-11-06 09:06:53,125 [INFO] Transformación completada en 0.02s 2025-11-06 09:06:53,125 [INFO] Paso 3: Carga de datos 2025-11-06 09:06:53,204 [INFO] Skipped manually modified orden: 7423 2025-11-06 09:06:53,204 [INFO] Skipped manually modified orden: 7486 2025-11-06 09:06:53,207 [INFO] Skipped manually modified orden: 7483 2025-11-06 09:06:53,207 [INFO] Skipped manually modified orden: 7454 2025-11-06 09:06:53,208 [INFO] Skipped manually modified orden: 7448 2025-11-06 09:06:53,209 [INFO] Skipped manually modified orden: 7458 2025-11-06 09:06:53,209 [INFO] Skipped manually modified orden: 7501 2025-11-06 09:06:53,209 [INFO] Skipped manually modified orden: 7374 2025-11-06 09:06:53,210 [INFO] Skipped manually modified orden: 7507 2025-11-06 09:06:53,210 [INFO] Skipped manually modified orden: 7527 2025-11-06 09:06:53,210 [INFO] Skipped manually modified orden: 7403 2025-11-06 09:06:53,211 [INFO] Skipped manually modified orden: 7497 2025-11-06 09:06:53,211 [INFO] Skipped manually modified orden: 7472 2025-11-06 09:06:53,211 [INFO] Skipped manually modified orden: 7487 2025-11-06 09:06:53,211 [INFO] Skipped manually modified orden: 7502 2025-11-06 09:06:53,212 [INFO] Skipped manually modified orden: 7392 2025-11-06 09:06:53,212 [INFO] Skipped manually modified orden: 7211 2025-11-06 09:06:53,213 [INFO] Skipped manually modified orden: 7499 2025-11-06 09:06:53,214 [INFO] Skipped manually modified orden: 7485 2025-11-06 09:06:53,214 [INFO] Skipped manually modified orden: 7505 2025-11-06 09:06:53,215 [INFO] Skipped manually modified orden: 7457 2025-11-06 09:06:53,215 [INFO] Skipped manually modified orden: 7498 2025-11-06 09:06:53,215 [INFO] Skipped manually modified orden: 7470 2025-11-06 09:06:53,216 [INFO] Skipped manually modified orden: 7434 2025-11-06 09:06:53,216 [INFO] Skipped manually modified orden: 7432 2025-11-06 09:06:53,216 [INFO] Skipped manually modified orden: 7503 2025-11-06 09:06:53,216 [INFO] Skipped manually modified orden: 7481 2025-11-06 09:06:53,217 [INFO] Skipped manually modified orden: 7426 2025-11-06 09:06:53,217 [INFO] Skipped manually modified orden: 7437 2025-11-06 09:06:53,218 [INFO] Skipped manually modified orden: 7473 2025-11-06 09:06:53,218 [INFO] Skipped manually modified orden: 7447 2025-11-06 09:06:53,218 [INFO] Skipped manually modified orden: 7488 2025-11-06 09:06:53,219 [INFO] Skipped manually modified orden: 7430 2025-11-06 09:06:53,220 [INFO] Skipped manually modified orden: 7460 2025-11-06 09:06:53,221 [INFO] Skipped manually modified orden: 7482 2025-11-06 09:06:53,221 [INFO] Skipped manually modified orden: 6855 2025-11-06 09:06:53,221 [INFO] Skipped manually modified orden: 6931 2025-11-06 09:06:53,222 [INFO] Skipped manually modified orden: 7489 2025-11-06 09:06:53,223 [INFO] Skipped manually modified orden: 7511 2025-11-06 09:06:53,223 [INFO] Skipped manually modified orden: 7435 2025-11-06 09:06:53,223 [INFO] Skipped manually modified orden: 7492 2025-11-06 09:06:53,224 [INFO] Skipped manually modified orden: 6373 2025-11-06 09:06:53,224 [INFO] Skipped manually modified orden: 7305 2025-11-06 09:06:53,225 [INFO] Skipped manually modified orden: 7509 2025-11-06 09:06:53,225 [INFO] Skipped manually modified orden: 7459 2025-11-06 09:06:53,225 [INFO] Skipped manually modified orden: 7466 2025-11-06 09:06:53,226 [INFO] Skipped manually modified orden: 7455 2025-11-06 09:06:53,226 [INFO] Skipped manually modified orden: 7477 2025-11-06 09:06:53,226 [INFO] Skipped manually modified orden: 7456 2025-11-06 09:06:53,227 [INFO] Skipped manually modified orden: 7453 2025-11-06 09:06:53,227 [INFO] Skipped manually modified orden: 7461 2025-11-06 09:06:53,227 [INFO] Skipped manually modified orden: 7397 2025-11-06 09:06:53,228 [INFO] Skipped manually modified orden: 7444 2025-11-06 09:06:53,228 [INFO] Skipped manually modified orden: 7496 2025-11-06 09:06:53,229 [INFO] Skipped manually modified orden: 7493 2025-11-06 09:06:53,229 [INFO] Skipped manually modified orden: 7521 2025-11-06 09:06:53,229 [INFO] Skipped manually modified orden: 7286 2025-11-06 09:06:53,230 [INFO] Skipped manually modified orden: 7518 2025-11-06 09:06:53,231 [INFO] Skipped manually modified orden: 7450 2025-11-06 09:06:53,231 [INFO] Skipped manually modified orden: 7462 2025-11-06 09:06:53,231 [INFO] Skipped manually modified orden: 7510 2025-11-06 09:06:53,232 [INFO] Skipped manually modified orden: 7504 2025-11-06 09:06:53,233 [INFO] Skipped manually modified orden: 7522 2025-11-06 09:06:53,233 [INFO] Skipped manually modified orden: 7355 2025-11-06 09:06:53,234 [INFO] Skipped manually modified orden: 7478 2025-11-06 09:06:53,235 [INFO] Skipped manually modified orden: 7524 2025-11-06 09:06:53,235 [INFO] Skipped manually modified orden: 7464 2025-11-06 09:06:53,236 [INFO] Skipped manually modified orden: 7495 2025-11-06 09:06:53,236 [INFO] Skipped manually modified orden: 7451 2025-11-06 09:06:53,236 [INFO] Skipped manually modified orden: 7436 2025-11-06 09:06:53,238 [INFO] Skipped manually modified orden: 7468 2025-11-06 09:06:53,238 [INFO] Skipped manually modified orden: 7449 2025-11-06 09:06:53,238 [INFO] Skipped manually modified orden: 7433 2025-11-06 09:06:53,238 [INFO] Skipped manually modified orden: 7452 2025-11-06 09:06:53,239 [INFO] Skipped manually modified orden: 7508 2025-11-06 09:06:53,239 [INFO] Skipped manually modified orden: 7446 2025-11-06 09:06:53,240 [INFO] Skipped manually modified orden: 7513 2025-11-06 09:06:53,240 [INFO] Skipped manually modified orden: 7471 2025-11-06 09:06:53,241 [INFO] Skipped manually modified orden: 7480 2025-11-06 09:06:53,241 [INFO] Skipped manually modified orden: 7479 2025-11-06 09:06:53,242 [INFO] Skipped manually modified orden: 7440 2025-11-06 09:06:53,242 [INFO] Skipped manually modified orden: 6328 2025-11-06 09:06:53,242 [INFO] Skipped manually modified orden: 7516 2025-11-06 09:06:53,244 [INFO] Skipped manually modified orden: 7465 2025-11-06 09:06:53,244 [INFO] Skipped manually modified orden: 7491 2025-11-06 09:06:53,245 [INFO] Skipped manually modified orden: 7506 2025-11-06 09:06:53,245 [INFO] Skipped manually modified orden: 7445 2025-11-06 09:06:53,245 [INFO] Skipped manually modified orden: 7429 2025-11-06 09:06:53,245 [INFO] Skipped manually modified orden: 7463 2025-11-06 09:06:53,246 [INFO] Skipped manually modified orden: 7476 2025-11-06 09:06:53,246 [INFO] Skipped manually modified orden: 7484 2025-11-06 09:06:53,246 [INFO] Skipped manually modified orden: 7441 2025-11-06 09:06:53,247 [INFO] Skipped manually modified orden: 7431 2025-11-06 09:06:53,247 [INFO] Skipped manually modified orden: 7467 2025-11-06 09:06:53,248 [INFO] Skipped manually modified orden: 7520 2025-11-06 09:06:53,248 [INFO] Skipped manually modified orden: 7500 2025-11-06 09:06:53,248 [INFO] Skipped manually modified orden: 7439 2025-11-06 09:06:53,250 [INFO] Merge de órdenes completado: 0 insertadas, 41 actualizadas, 97 omitidas 2025-11-06 09:06:53,259 [INFO] Skipped manually modified pedido: 6328_8936 2025-11-06 09:06:53,260 [INFO] Skipped manually modified pedido: 6373_8992 2025-11-06 09:06:53,260 [INFO] Skipped manually modified pedido: 6931_9861 2025-11-06 09:06:53,261 [INFO] Skipped manually modified pedido: 7286_10342 2025-11-06 09:06:53,261 [INFO] Skipped manually modified pedido: 7286_10342 2025-11-06 09:06:53,261 [INFO] Skipped manually modified pedido: 7286_10342 2025-11-06 09:06:53,262 [INFO] Skipped manually modified pedido: 7300_10373 2025-11-06 09:06:53,267 [INFO] Skipped manually modified pedido: 7314_10393 2025-11-06 09:06:53,267 [INFO] Skipped manually modified pedido: 7314_10394 2025-11-06 09:06:53,268 [INFO] Skipped manually modified pedido: 7314_10395 2025-11-06 09:06:53,268 [INFO] Skipped manually modified pedido: 7315_10397 2025-11-06 09:06:53,268 [INFO] Skipped manually modified pedido: 7315_10397 2025-11-06 09:06:53,269 [INFO] Skipped manually modified pedido: 7315_10397 2025-11-06 09:06:53,269 [INFO] Skipped manually modified pedido: 7315_10397 2025-11-06 09:06:53,269 [INFO] Skipped manually modified pedido: 7315_10398 2025-11-06 09:06:53,270 [INFO] Skipped manually modified pedido: 7339_10431 2025-11-06 09:06:53,270 [INFO] Skipped manually modified pedido: 7340_10432 2025-11-06 09:06:53,270 [INFO] Skipped manually modified pedido: 7340_10432 2025-11-06 09:06:53,271 [INFO] Skipped manually modified pedido: 7341_10433 2025-11-06 09:06:53,273 [INFO] Skipped manually modified pedido: 7343_10438 2025-11-06 09:06:53,274 [INFO] Skipped manually modified pedido: 7343_10440 2025-11-06 09:06:53,280 [INFO] Skipped manually modified pedido: 7351_10456 2025-11-06 09:06:53,280 [INFO] Skipped manually modified pedido: 7351_10456 2025-11-06 09:06:53,282 [INFO] Skipped manually modified pedido: 7355_10463 2025-11-06 09:06:53,283 [INFO] Skipped manually modified pedido: 7374_10488 2025-11-06 09:06:53,287 [INFO] Skipped manually modified pedido: 7393_10520 2025-11-06 09:06:53,290 [INFO] Skipped manually modified pedido: 7403_10538 2025-11-06 09:06:53,294 [INFO] Skipped manually modified pedido: 7423_10569 2025-11-06 09:06:53,295 [INFO] Skipped manually modified pedido: 7426_10574 2025-11-06 09:06:53,295 [INFO] Skipped manually modified pedido: 7429_10577 2025-11-06 09:06:53,295 [INFO] Skipped manually modified pedido: 7429_10577 2025-11-06 09:06:53,295 [INFO] Skipped manually modified pedido: 7430_10578 2025-11-06 09:06:53,295 [INFO] Skipped manually modified pedido: 7437_10585 2025-11-06 09:06:53,296 [INFO] Skipped manually modified pedido: 7440_10590 2025-11-06 09:06:53,296 [INFO] Skipped manually modified pedido: 7440_10591 2025-11-06 09:06:53,296 [INFO] Skipped manually modified pedido: 7440_10592 2025-11-06 09:06:53,296 [INFO] Skipped manually modified pedido: 7441_10593 2025-11-06 09:06:53,297 [INFO] Skipped manually modified pedido: 7444_10596 2025-11-06 09:06:53,297 [INFO] Skipped manually modified pedido: 7444_10596 2025-11-06 09:06:53,297 [INFO] Skipped manually modified pedido: 7446_10598 2025-11-06 09:06:53,298 [INFO] Skipped manually modified pedido: 7447_10599 2025-11-06 09:06:53,298 [INFO] Skipped manually modified pedido: 7448_10601 2025-11-06 09:06:53,298 [INFO] Skipped manually modified pedido: 7450_10603 2025-11-06 09:06:53,298 [INFO] Skipped manually modified pedido: 7451_10604 2025-11-06 09:06:53,299 [INFO] Skipped manually modified pedido: 7453_10606 2025-11-06 09:06:53,299 [INFO] Skipped manually modified pedido: 7456_10610 2025-11-06 09:06:53,299 [INFO] Skipped manually modified pedido: 7459_10613 2025-11-06 09:06:53,299 [INFO] Skipped manually modified pedido: 7460_10614 2025-11-06 09:06:53,299 [INFO] Skipped manually modified pedido: 7460_10614 2025-11-06 09:06:53,300 [INFO] Skipped manually modified pedido: 7461_10615 2025-11-06 09:06:53,300 [INFO] Skipped manually modified pedido: 7464_10619 2025-11-06 09:06:53,300 [INFO] Skipped manually modified pedido: 7465_10620 2025-11-06 09:06:53,300 [INFO] Skipped manually modified pedido: 7466_10621 2025-11-06 09:06:53,300 [INFO] Skipped manually modified pedido: 7466_10621 2025-11-06 09:06:53,301 [INFO] Skipped manually modified pedido: 7467_10623 2025-11-06 09:06:53,303 [INFO] Skipped manually modified pedido: 7472_10630 2025-11-06 09:06:53,303 [INFO] Skipped manually modified pedido: 7472_10631 2025-11-06 09:06:53,303 [INFO] Skipped manually modified pedido: 7473_10633 2025-11-06 09:06:53,304 [INFO] Skipped manually modified pedido: 7476_10636 2025-11-06 09:06:53,304 [INFO] Skipped manually modified pedido: 7476_10637 2025-11-06 09:06:53,304 [INFO] Skipped manually modified pedido: 7479_10640 2025-11-06 09:06:53,305 [INFO] Skipped manually modified pedido: 7481_10642 2025-11-06 09:06:53,305 [INFO] Skipped manually modified pedido: 7481_10642 2025-11-06 09:06:53,305 [INFO] Skipped manually modified pedido: 7486_10648 2025-11-06 09:06:53,305 [INFO] Skipped manually modified pedido: 7487_10649 2025-11-06 09:06:53,306 [INFO] Skipped manually modified pedido: 7487_10650 2025-11-06 09:06:53,306 [INFO] Skipped manually modified pedido: 7488_10651 2025-11-06 09:06:53,306 [INFO] Skipped manually modified pedido: 7489_10652 2025-11-06 09:06:53,306 [INFO] Skipped manually modified pedido: 7492_10656 2025-11-06 09:06:53,308 [INFO] Skipped manually modified pedido: 7496_10667 2025-11-06 09:06:53,308 [INFO] Skipped manually modified pedido: 7497_10668 2025-11-06 09:06:53,308 [INFO] Skipped manually modified pedido: 7498_10669 2025-11-06 09:06:53,309 [INFO] Skipped manually modified pedido: 7498_10669 2025-11-06 09:06:53,309 [INFO] Skipped manually modified pedido: 7499_10670 2025-11-06 09:06:53,309 [INFO] Skipped manually modified pedido: 7501_10672 2025-11-06 09:06:53,309 [INFO] Skipped manually modified pedido: 7503_10674 2025-11-06 09:06:53,310 [INFO] Skipped manually modified pedido: 7503_10674 2025-11-06 09:06:53,310 [INFO] Skipped manually modified pedido: 7504_10675 2025-11-06 09:06:53,310 [INFO] Skipped manually modified pedido: 7506_10678 2025-11-06 09:06:53,310 [INFO] Skipped manually modified pedido: 7507_10679 2025-11-06 09:06:53,311 [INFO] Skipped manually modified pedido: 7508_10680 2025-11-06 09:06:53,311 [INFO] Skipped manually modified pedido: 7509_10681 2025-11-06 09:06:53,311 [INFO] Skipped manually modified pedido: 7510_10682 2025-11-06 09:06:53,311 [INFO] Skipped manually modified pedido: 7516_10688 2025-11-06 09:06:53,313 [INFO] Skipped manually modified pedido: 7521_10694 2025-11-06 09:06:53,313 [INFO] Skipped manually modified pedido: 7522_10695 2025-11-06 09:06:53,313 [INFO] Skipped manually modified pedido: 7522_10695 2025-11-06 09:06:53,314 [INFO] Skipped manually modified pedido: 7522_10695 2025-11-06 09:06:53,314 [INFO] Skipped manually modified pedido: 7522_10696 2025-11-06 09:06:53,314 [INFO] Skipped manually modified pedido: 7522_10696 2025-11-06 09:06:53,314 [INFO] Skipped manually modified pedido: 7522_10696 2025-11-06 09:06:53,322 [INFO] Skipped manually modified pedido: 7527_10702 2025-11-06 09:06:53,325 [ERROR] Error en merge de pedidos: insert or update on table "pedidos" violates foreign key constraint "fk_pedidos_orden" DETAIL: Key (orden_id)=(7531) is not present in table "ordenes". 2025-11-06 09:06:53,325 [INFO] Carga completada en 0.20s 2025-11-06 09:06:53,325 [WARNING] ETL completado con errores - Órdenes: True, Pedidos: False 2025-11-06 09:06:53,325 [WARNING] === PROCESO ETL COMPLETADO CON ERRORES === 2025-11-06 09:06:53,325 [INFO] Resumen: órdenes 0, pedidos 0 2025-11-06 09:06:54,364 [INFO] Notificación enviada correctamente