Ver Log ETL

etl_20260503_073001.log

Volver a Logs Dashboard
Archivo:
etl_20260503_073001.log
Modificado:
03/05/2026 07:30:06
Tamaño:
18.5 KB
Líneas:
223 líneas
2026-05-03 07:30:01,439 [INFO] Iniciando proceso ETL... 2026-05-03 07:30:01,439 [INFO] === INICIO ETL === 2026-05-03 07:30:01,439 [INFO] Paso 0: Sincronización de IDs 2026-05-03 07:30:01,439 [INFO] Sincronizando tabla pedidos_id_mapping... 2026-05-03 07:30:01,439 [INFO] Intentando conectar a SQL Server... 2026-05-03 07:30:02,526 [INFO] Conexión SQL Server exitosa 2026-05-03 07:30:02,893 [INFO] Sincronización completada: 0 nuevos IDs asignados 2026-05-03 07:30:02,893 [INFO] Paso 1: Extracción de datos 2026-05-03 07:30:02,893 [INFO] Iniciando extracción de cabeceras 2026-05-03 07:30:02,893 [INFO] Extrayendo órdenes desde linux_ordenes... 2026-05-03 07:30:02,893 [INFO] Intentando conectar a SQL Server... 2026-05-03 07:30:03,501 [INFO] Conexión SQL Server exitosa 2026-05-03 07:30:03,501 [INFO] Ejecutando consulta (últimos 30 días desde 2026-04-03): SELECT numero, cliente, vendedor, fecha_entrega, dias_restantes, estatus FROM dbo.linux_ordenes WHERE fecha_entrega >= ? 2026-05-03 07:30:04,129 [INFO] Extraídas 170 órdenes 2026-05-03 07:30:04,129 [INFO] [DEBUG] Columnas ordenes: ['numero', 'cliente', 'vendedor', 'fecha_entrega', 'dias_restantes', 'estatus'] 2026-05-03 07:30:04,129 [INFO] [DEBUG] dtypes ordenes: {'numero': dtype('O'), 'cliente': dtype('O'), 'vendedor': dtype('O'), 'fecha_entrega': dtype('O'), 'dias_restantes': dtype('int64'), 'estatus': dtype('O')} 2026-05-03 07:30:04,139 [INFO] [DEBUG] Nulos en fecha_entrega (ordenes) tras limpiar: 0 2026-05-03 07:30:04,235 [INFO] Iniciando extracción de líneas 2026-05-03 07:30:04,235 [INFO] Extrayendo pedidos desde linux_pedidos... 2026-05-03 07:30:04,235 [INFO] Intentando conectar a SQL Server... 2026-05-03 07:30:04,818 [INFO] Conexión SQL Server exitosa 2026-05-03 07:30:04,819 [INFO] Ejecutando consulta (últimos 30 días desde 2026-04-03): SELECT id, orden_id, clave, producto, unidad, cantidad, surtido, liq, saldo, fecha_entrega, remision FROM dbo.linux_pedidos WHERE fecha_entrega >= ? 2026-05-03 07:30:05,560 [INFO] Extraídos 479 pedidos 2026-05-03 07:30:05,560 [INFO] [DEBUG] Columnas pedidos: ['id', 'orden_id', 'clave', 'producto', 'unidad', 'cantidad', 'surtido', 'liq', 'saldo', 'fecha_entrega', 'remision'] 2026-05-03 07:30:05,561 [INFO] [DEBUG] dtypes pedidos: {'id': dtype('O'), 'orden_id': dtype('float64'), 'clave': dtype('O'), 'producto': dtype('O'), 'unidad': dtype('O'), 'cantidad': dtype('int64'), 'surtido': dtype('int64'), 'liq': dtype('int64'), 'saldo': dtype('int64'), 'fecha_entrega': dtype('O'), 'remision': dtype('float64')} 2026-05-03 07:30:05,567 [INFO] [DEBUG] Nulos en fecha_entrega (pedidos) tras limpiar: 0 2026-05-03 07:30:05,663 [INFO] Extraídas 479 líneas 2026-05-03 07:30:05,663 [INFO] Extracción completada en 2.77s 2026-05-03 07:30:05,663 [INFO] Paso 2: Transformación de datos 2026-05-03 07:30:05,663 [INFO] Transformando datos de cabeceras 2026-05-03 07:30:05,664 [INFO] [DEBUG] Nulos por columna (cabeceras): {'numero': 0, 'cliente': 0, 'vendedor': 0, 'fecha_entrega': 0, 'dias_restantes': 0, 'estatus': 0} 2026-05-03 07:30:05,671 [INFO] Transformadas 170 cabeceras 2026-05-03 07:30:05,672 [INFO] [DEBUG] Ejemplo cabeceras transformadas (3): [{'id': '8063', 'numero': '8063', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 92, 'prioridad': 'PROGRAMADO'}, {'id': '8005', 'numero': '8005', 'cliente': 'SISTEMAS AUTOMOTRICES DE MEXICO', 'vendedor': 'ERICKA IVONNE DELGADO HUERTA', 'fecha_entrega': '2026-04-07', 'estatus': 'completado', 'dias_restantes': -26, 'prioridad': 'URGENTE'}, {'id': '7946', 'numero': '7946', 'cliente': 'HUSSMANN CORPORATION', 'vendedor': 'LF', 'fecha_entrega': '2026-08-03', 'estatus': 'pendiente', 'dias_restantes': 92, 'prioridad': 'PROGRAMADO'}] 2026-05-03 07:30:05,672 [INFO] Transformando datos de líneas 2026-05-03 07:30:05,672 [INFO] [DEBUG] Nulos por columna (lineas): {'id': 0, 'orden_id': 0, 'clave': 0, 'producto': 0, 'unidad': 0, 'cantidad': 0, 'surtido': 0, 'liq': 0, 'saldo': 0, 'fecha_entrega': 0, 'remision': 120} 2026-05-03 07:30:05,690 [INFO] Transformadas 479 líneas 2026-05-03 07:30:05,691 [INFO] [DEBUG] Ejemplo líneas transformadas (3): [{'id': '7746_122', 'ID_UNICO': '7746_122', 'orden_id': '7746.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 12500, 'surtido': 12500, 'liq': 12500, 'saldo': 0, 'fecha_entrega': '2026-08-03', 'remision': '5570.0', 'dias_restantes': 92, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7952_467', 'ID_UNICO': '7952_467', 'orden_id': '7952.0', 'clave': '8100020', 'producto': 'TRANSFER TAPE PREMIUM 1', 'unidad': 'METRO', 'cantidad': 87500, 'surtido': 36000, 'liq': 87500, 'saldo': 51500, 'fecha_entrega': '2026-08-03', 'remision': '5776.0', 'dias_restantes': 92, 'entregado': 0, 'estatus': 'pendiente', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}, {'id': '7980_506', 'ID_UNICO': '7980_506', 'orden_id': '7980.0', 'clave': '8000004', 'producto': 'MASILLA SELLADORA 1003.1H', 'unidad': 'KG', 'cantidad': 357, 'surtido': 357, 'liq': 357, 'saldo': 0, 'fecha_entrega': '2026-04-27', 'remision': '5791.0', 'dias_restantes': -6, 'entregado': 1, 'estatus': 'parcialmente_completado', 'fecha_completado': None, 'F_Alta': None, 'remision_producto': None}] 2026-05-03 07:30:05,691 [INFO] Transformación completada en 0.03s 2026-05-03 07:30:05,691 [INFO] Paso 3: Carga de datos 2026-05-03 07:30:05,770 [INFO] Skipped manually modified orden: 7729 2026-05-03 07:30:05,773 [INFO] Skipped manually modified orden: 8087 2026-05-03 07:30:05,774 [INFO] Skipped manually modified orden: 8058 2026-05-03 07:30:05,774 [INFO] Skipped manually modified orden: 7751 2026-05-03 07:30:05,775 [INFO] Skipped manually modified orden: 8079 2026-05-03 07:30:05,778 [INFO] Skipped manually modified orden: 8081 2026-05-03 07:30:05,781 [INFO] Skipped manually modified orden: 8014 2026-05-03 07:30:05,782 [INFO] Skipped manually modified orden: 8078 2026-05-03 07:30:05,783 [INFO] Skipped manually modified orden: 8090 2026-05-03 07:30:05,784 [INFO] Skipped manually modified orden: 8080 2026-05-03 07:30:05,786 [INFO] Skipped manually modified orden: 8086 2026-05-03 07:30:05,786 [INFO] Skipped manually modified orden: 8085 2026-05-03 07:30:05,786 [INFO] Skipped manually modified orden: 8089 2026-05-03 07:30:05,789 [INFO] Skipped manually modified orden: 7835 2026-05-03 07:30:05,789 [INFO] Skipped manually modified orden: 8091 2026-05-03 07:30:05,790 [INFO] Skipped manually modified orden: 7823 2026-05-03 07:30:05,798 [INFO] Skipped manually modified orden: 7719 2026-05-03 07:30:05,800 [INFO] Skipped manually modified orden: 7881 2026-05-03 07:30:05,801 [INFO] Skipped manually modified orden: 8050 2026-05-03 07:30:05,803 [INFO] Skipped manually modified orden: 7833 2026-05-03 07:30:05,804 [INFO] Skipped manually modified orden: 8084 2026-05-03 07:30:05,810 [INFO] Skipped manually modified orden: 8077 2026-05-03 07:30:05,811 [INFO] Skipped manually modified orden: 8083 2026-05-03 07:30:05,813 [INFO] Skipped manually modified orden: 7718 2026-05-03 07:30:05,814 [INFO] Skipped manually modified orden: 8094 2026-05-03 07:30:05,816 [INFO] Skipped manually modified orden: 7720 2026-05-03 07:30:05,818 [INFO] Skipped manually modified orden: 8082 2026-05-03 07:30:05,819 [INFO] Skipped manually modified orden: 8076 2026-05-03 07:30:05,824 [INFO] Skipped manually modified orden: 7899 2026-05-03 07:30:05,824 [INFO] Skipped manually modified orden: 8088 2026-05-03 07:30:05,825 [INFO] Skipped manually modified orden: 8039 2026-05-03 07:30:05,827 [INFO] Skipped manually modified orden: 8071 2026-05-03 07:30:05,828 [INFO] Skipped manually modified orden: 7792 2026-05-03 07:30:05,831 [INFO] Merge de órdenes completado: 0 insertadas, 137 actualizadas, 33 omitidas 2026-05-03 07:30:05,850 [INFO] Skipped manually modified pedido: 7980_506 2026-05-03 07:30:05,850 [INFO] Skipped manually modified pedido: 8073_699 2026-05-03 07:30:05,854 [INFO] Skipped manually modified pedido: 8082_708 2026-05-03 07:30:05,858 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,861 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:05,871 [INFO] Skipped manually modified pedido: 8078_704 2026-05-03 07:30:05,872 [INFO] Skipped manually modified pedido: 8094_721 2026-05-03 07:30:05,873 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:05,874 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:05,875 [INFO] Skipped manually modified pedido: 8051_641 2026-05-03 07:30:05,880 [INFO] Skipped manually modified pedido: 7898_363 2026-05-03 07:30:05,883 [INFO] Skipped manually modified pedido: 7980_507 2026-05-03 07:30:05,883 [INFO] Skipped manually modified pedido: 8039_608 2026-05-03 07:30:05,884 [INFO] Skipped manually modified pedido: 7807_215 2026-05-03 07:30:05,887 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:05,887 [INFO] Skipped manually modified pedido: 7896_358 2026-05-03 07:30:05,888 [INFO] Skipped manually modified pedido: 8051_641 2026-05-03 07:30:05,891 [INFO] Skipped manually modified pedido: 7808_217 2026-05-03 07:30:05,894 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,896 [INFO] Skipped manually modified pedido: 8090_717 2026-05-03 07:30:05,899 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,900 [INFO] Skipped manually modified pedido: 7838_267 2026-05-03 07:30:05,901 [INFO] Skipped manually modified pedido: 7980_509 2026-05-03 07:30:05,902 [INFO] Skipped manually modified pedido: 8051_639 2026-05-03 07:30:05,904 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,912 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:05,912 [INFO] Skipped manually modified pedido: 7808_217 2026-05-03 07:30:05,914 [INFO] Skipped manually modified pedido: 8051_641 2026-05-03 07:30:05,914 [INFO] Skipped manually modified pedido: 7980_510 2026-05-03 07:30:05,917 [INFO] Skipped manually modified pedido: 7980_507 2026-05-03 07:30:05,927 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,932 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:05,937 [INFO] Skipped manually modified pedido: 8051_639 2026-05-03 07:30:05,937 [INFO] Skipped manually modified pedido: 7808_217 2026-05-03 07:30:05,941 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,944 [INFO] Skipped manually modified pedido: 8066_697 2026-05-03 07:30:05,946 [INFO] Skipped manually modified pedido: 7807_215 2026-05-03 07:30:05,947 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,950 [INFO] Skipped manually modified pedido: 7801_208 2026-05-03 07:30:05,951 [INFO] Skipped manually modified pedido: 7980_506 2026-05-03 07:30:05,958 [INFO] Skipped manually modified pedido: 8071_696 2026-05-03 07:30:05,961 [INFO] Skipped manually modified pedido: 8051_639 2026-05-03 07:30:05,963 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:05,963 [INFO] Skipped manually modified pedido: 7980_506 2026-05-03 07:30:05,964 [INFO] Skipped manually modified pedido: 8039_607 2026-05-03 07:30:05,966 [INFO] Skipped manually modified pedido: 7898_364 2026-05-03 07:30:05,967 [INFO] Skipped manually modified pedido: 8058_672 2026-05-03 07:30:05,971 [INFO] Skipped manually modified pedido: 8051_654 2026-05-03 07:30:05,973 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:05,979 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:05,979 [INFO] Skipped manually modified pedido: 8051_655 2026-05-03 07:30:05,980 [INFO] Skipped manually modified pedido: 7838_266 2026-05-03 07:30:05,982 [INFO] Skipped manually modified pedido: 7807_215 2026-05-03 07:30:05,985 [INFO] Skipped manually modified pedido: 8076_702 2026-05-03 07:30:05,986 [INFO] Skipped manually modified pedido: 8051_654 2026-05-03 07:30:05,991 [INFO] Skipped manually modified pedido: 7838_267 2026-05-03 07:30:05,991 [INFO] Skipped manually modified pedido: 7980_507 2026-05-03 07:30:05,993 [INFO] Skipped manually modified pedido: 8077_703 2026-05-03 07:30:05,997 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:05,997 [INFO] Skipped manually modified pedido: 7899_365 2026-05-03 07:30:05,998 [INFO] Skipped manually modified pedido: 7980_507 2026-05-03 07:30:06,003 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,007 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,008 [INFO] Skipped manually modified pedido: 8068_693 2026-05-03 07:30:06,008 [INFO] Skipped manually modified pedido: 7838_267 2026-05-03 07:30:06,010 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:06,010 [INFO] Skipped manually modified pedido: 7980_506 2026-05-03 07:30:06,011 [INFO] Skipped manually modified pedido: 8080_706 2026-05-03 07:30:06,014 [INFO] Skipped manually modified pedido: 8051_655 2026-05-03 07:30:06,015 [INFO] Skipped manually modified pedido: 8039_606 2026-05-03 07:30:06,016 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:06,019 [INFO] Skipped manually modified pedido: 8084_710 2026-05-03 07:30:06,021 [INFO] Skipped manually modified pedido: 7703_39 2026-05-03 07:30:06,021 [INFO] Skipped manually modified pedido: 7838_267 2026-05-03 07:30:06,024 [INFO] Skipped manually modified pedido: 7838_266 2026-05-03 07:30:06,025 [INFO] Skipped manually modified pedido: 8051_654 2026-05-03 07:30:06,037 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:06,039 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:06,039 [INFO] Skipped manually modified pedido: 7899_365 2026-05-03 07:30:06,041 [INFO] Skipped manually modified pedido: 7985_519 2026-05-03 07:30:06,041 [INFO] Skipped manually modified pedido: 7749_125 2026-05-03 07:30:06,042 [INFO] Skipped manually modified pedido: 7864_297 2026-05-03 07:30:06,049 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,053 [INFO] Skipped manually modified pedido: 7980_506 2026-05-03 07:30:06,055 [INFO] Skipped manually modified pedido: 7896_358 2026-05-03 07:30:06,057 [INFO] Skipped manually modified pedido: 8051_656 2026-05-03 07:30:06,057 [INFO] Skipped manually modified pedido: 8081_707 2026-05-03 07:30:06,058 [INFO] Skipped manually modified pedido: 8051_656 2026-05-03 07:30:06,062 [INFO] Skipped manually modified pedido: 7980_510 2026-05-03 07:30:06,067 [INFO] Skipped manually modified pedido: 7749_125 2026-05-03 07:30:06,068 [INFO] Skipped manually modified pedido: 7980_510 2026-05-03 07:30:06,073 [INFO] Skipped manually modified pedido: 7899_365 2026-05-03 07:30:06,078 [INFO] Skipped manually modified pedido: 8086_713 2026-05-03 07:30:06,084 [INFO] Skipped manually modified pedido: 7763_151 2026-05-03 07:30:06,096 [INFO] Skipped manually modified pedido: 7801_208 2026-05-03 07:30:06,098 [INFO] Skipped manually modified pedido: 7808_217 2026-05-03 07:30:06,103 [INFO] Skipped manually modified pedido: 7899_365 2026-05-03 07:30:06,106 [INFO] Skipped manually modified pedido: 8083_709 2026-05-03 07:30:06,110 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,113 [INFO] Skipped manually modified pedido: 8051_655 2026-05-03 07:30:06,115 [INFO] Skipped manually modified pedido: 7980_509 2026-05-03 07:30:06,119 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,121 [INFO] Skipped manually modified pedido: 7980_507 2026-05-03 07:30:06,124 [INFO] Skipped manually modified pedido: 7763_151 2026-05-03 07:30:06,125 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,128 [INFO] Skipped manually modified pedido: 7896_358 2026-05-03 07:30:06,129 [INFO] Skipped manually modified pedido: 7980_509 2026-05-03 07:30:06,131 [INFO] Skipped manually modified pedido: 8094_722 2026-05-03 07:30:06,132 [INFO] Skipped manually modified pedido: 7749_125 2026-05-03 07:30:06,135 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:06,137 [INFO] Skipped manually modified pedido: 8088_715 2026-05-03 07:30:06,142 [INFO] Skipped manually modified pedido: 8051_653 2026-05-03 07:30:06,148 [INFO] Skipped manually modified pedido: 8087_714 2026-05-03 07:30:06,149 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:06,153 [INFO] Skipped manually modified pedido: 7801_208 2026-05-03 07:30:06,154 [INFO] Skipped manually modified pedido: 8058_673 2026-05-03 07:30:06,167 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,167 [INFO] Skipped manually modified pedido: 7985_519 2026-05-03 07:30:06,169 [INFO] Skipped manually modified pedido: 7980_509 2026-05-03 07:30:06,174 [INFO] Skipped manually modified pedido: 7808_217 2026-05-03 07:30:06,175 [INFO] Skipped manually modified pedido: 7980_510 2026-05-03 07:30:06,185 [INFO] Skipped manually modified pedido: 8089_716 2026-05-03 07:30:06,189 [INFO] Skipped manually modified pedido: 8051_653 2026-05-03 07:30:06,189 [INFO] Skipped manually modified pedido: 8079_705 2026-05-03 07:30:06,192 [INFO] Skipped manually modified pedido: 8051_653 2026-05-03 07:30:06,196 [INFO] Skipped manually modified pedido: 7801_206 2026-05-03 07:30:06,199 [INFO] Skipped manually modified pedido: 7979_505 2026-05-03 07:30:06,203 [INFO] Skipped manually modified pedido: 7864_297 2026-05-03 07:30:06,204 [INFO] Skipped manually modified pedido: 8091_718 2026-05-03 07:30:06,206 [INFO] Skipped manually modified pedido: 7896_358 2026-05-03 07:30:06,210 [INFO] Skipped manually modified pedido: 7980_509 2026-05-03 07:30:06,211 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,213 [INFO] Skipped manually modified pedido: 7898_363 2026-05-03 07:30:06,215 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:06,222 [INFO] Skipped manually modified pedido: 7703_39 2026-05-03 07:30:06,223 [INFO] Skipped manually modified pedido: 7980_510 2026-05-03 07:30:06,225 [INFO] Skipped manually modified pedido: 7823_245 2026-05-03 07:30:06,229 [INFO] Skipped manually modified pedido: 7823_243 2026-05-03 07:30:06,231 [INFO] Skipped manually modified pedido: 7838_266 2026-05-03 07:30:06,232 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,239 [INFO] Skipped manually modified pedido: 8095_725 2026-05-03 07:30:06,241 [INFO] Skipped manually modified pedido: 7985_519 2026-05-03 07:30:06,245 [INFO] Skipped manually modified pedido: 7823_246 2026-05-03 07:30:06,249 [INFO] Skipped manually modified pedido: 7808_217 2026-05-03 07:30:06,252 [INFO] Merge de pedidos completado: 0 insertados, 335 actualizados, 144 omitidos 2026-05-03 07:30:06,253 [INFO] Carga completada en 0.56s 2026-05-03 07:30:06,253 [INFO] [SUCCESS] ETL completado sin errores 2026-05-03 07:30:06,253 [INFO] === PROCESO ETL COMPLETADO EXITOSAMENTE === 2026-05-03 07:30:06,253 [INFO] Resumen: órdenes 0, pedidos 0
Tip: Usa Ctrl+F para buscar texto específico en el log